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Intr oduction 

■ ■ ■ ■ g r * * 

^ 3fn 1969 the Chicago Board of Education initiated six Spanish bilingual 
t programs for students whose limited English proficiency prevented meaningful 

participation in the regular English curriculum. 1 Each year thereafter 
• bilingual services were expanded to accommodate the ever increasing number of 
students limited English proficiency from diverse language and cultural 
backgrounds. Since 1976 the overwhelming majority of limited English 
proficiency 'students enrolled in the Chicago public Schools have received 
bilingual services. 2 During Fiscal 1979 bilingual instruction was ofovided in 
16 lan^ages in more than 200 progf^ms ranging from prekind'ergarten through 
high school. V 

* *~ 
Bilingual program participants represented approximately 7 percent of the < 
■elementary enrollment in the Chicago public schools in Fiscal 1979^ Despite 
substantial .reductions in the total public school enrollment 'in Chicago * 
during the last decade, Hispanic and other ethnic minorities have shown 
marked increases; 4 Increases in the number of limited English proficiency 
students eligible for bilingual services point to the need for expanded 
services as well as the heightened importance these, services assume in the 
task of educating a significant portion of the school age population in - ' 
Chicago* » 

This report shows that FY1979 ^bilingual program participants demonstrated 
significant gains in English reading and mathematics, a pattern, which has been 
documented over a period of years. 3 It also concludes that students are being 
moved into the regular English curriculum within a period of three years/ a 
fact substantiated by the low incidence of fourth and fifth-year program 
enrollments during the last five years. 4 ^arge variationl in achievement among 
pupils were found, suggesting that a variety of factors play an important role 
in the academic achievement of bilingual program participants. Variations in 
program implementation, a factor which has been cited in numerous" evaluation 
studies of multi-site educational programs, may contribute significantly to the 
differences asr-ong students. The interaction of 'educational treatment and child 
input factors^must be examined in order to understand achievement differences 
among limited English proficiency students, as Cummins writes- * 

r 



"The lack of concern for the developmental interrelationships 
between language and thought in the bilingual chi4d is one of the 



i 

Funding for s these programs was provided by ESEA Title VII . 

2 Article 14C of'thte Illinois Pevised Statutes, Chapter 122 mandated transi- 
'tional bilingual Education for limited English proficiency students effective 
July 1, 1976. t • . , 

* 

3 Final Evaluation Report State-Funded Bilingual Education Program, Fiscal 
1974 « Departments f Government Funded Programs, 6oard of Education, City of 
Chicago; Chicago's ffilingual Program Evaluation Report 1975-76. Department 
of Research and Evaluation, City of Chicago. 

4 Ibid . 



J- 



ina jor reasons why evaluations and research have provided s^o little 
data on the dynamics of the bilingual child's interaction with his 
education environment."^* * 

A noteworthy finding of the report is the lack of significant differences 
in English achievement gains attributable to the amount "of time limited" 
English proficiency students spend in an English classroom. This points to 
the need for a more in-depth -analysis of the relationship between instructional 
program types, chilli input factors, and achievement* It also underscores the 
.necessity of broadening the measures of progranyef fectiveness to include*both * 
native language and English acljieyement + 

Long-term studies of bilingual instruction in other parts of the country 
suggest that bilingual instruction may have a cbjwnlative effect with results 
that may not show up in short-term, one-ye^r-at-a-time evaluations, 6 The 
transitional study initiated in 1978 partially recognized! this need, but in 
the future, outcome measures must be linked to a thorough documentation of 
process variables* 

Today, bilingual services for limited English proficiency students are 
generally a reality. The impetus>£or future evaluations nvdst |be to 
isolate and understand the strategies for producing better programs for 
students with varying needs. 



D James Cummins, "Linguistic Interdependence and the Educational development of 
Bilingual Children" Review of Educational Pesearch , Spring 1979, Vol* 49, 
No. 2, p. 227. ^ 

6 Alan Pifer. "Bilingual Education and the Hispanic Challenge" Annual Report 
Carnegie ^Corpora t ion of New Jfork , 1979, pg. 12. 



Summary of Findings 

Eighty-seven percent of all students receiving bilingual services were at 

the elementary level, 13 ^percent at the secondary level.. Of the elementary level 

students, 60 percent were in the primary cycle ages 4-8. 

. Students most needing bilingual instruction were i£s primary recipients: 59 per- 
cent of all elementary level participants had little or only partial fluency in 
English; 25 percent had barely adequate levels of English fluency, it can be 41 
concluded from these data that the majority of students receiving bilingual 
services had only marginal fluency in English, a condition which would have 
prevented meaningful participation in the regular English curriculum. 

Students receiving bilingual services at the high school level tended to be 
"new arrivals" to the .Chicago public schools as evidenced by the overwhelm- 
ing number born outside the continental U.S., the low English proficiency 
levels, and the high concentration of s<jadents in the first and second years of 
bilingual instruction* 

There was a substantial influx of new students into bj^ingual and Engiish as a 
Second Language programs, The number of participants reported increase^ 17 per- 
cent in the first five ntonths of calendar year 1979. Seventy percent of the 
increase was in the first year enrollment. 



More than half of all s-tudents participating in bilingual programs were in 
their first year; 32 percent were in their second year; 14 percent were in their 
third year. Onl'y 3.5 ^percent had been enrolled for four or five years. The 
sharp decline in the number of students^ receiving services subsecruent to the 
third year indicates that stud^jits are moving into the regular English program, 
♦ 

Sixty-six percent of the elementary level students receiving bilingual* 1f * 
services progressed* to a higher English instructional category during the 
1978-79 academic year. The greatest gains were experienced by those 
students with the lowest English proficiency* 

Sixty percent of the Elementary level students receiving bilingual services 
received 50 percent or more of their instruction in English, The percent of 
English instruction was substantially higher for high school students. 

As a student's ^English fluency increased, so did the amount of instruction 
in English which - he/she ^received . * 
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Students receiving bilingual services gained on the average 7.4 months in 
Heading Comprehension and 8 months i n math as measured by the appropriate' 
J subtests bf th'e-ITFS.'' * 

• * i 

AVERAGE* ITBS GAINS I FY 1979) 

R FADING GAINS (MONTHS 5 MATH GAINS (MONTHS) , " ~" 

F ILINGU AL ,7,4 8.0 

TITLE I 7.4, % ' v 7. 3 

CITY-WIDE 4 ' 8.1 * ^8,3 

Bilingual program participants demonstrated gains of 7.5 months in Reading and 
9.7 months in *Ma thematic s as measured by the Continuous Progress/Mastery Learning 
* (CP/ML) levels. , $ 

The amount of gain in either Reading or Math (ITBS) appears to be only marginally 
related to instructional time in English. Less than two percent of the dif- 
ference in reading gain of a sample of students could be accounted for by an 
increase in instructional time in English. ^ 
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:y ievels 



• English proficiency levels 9 

I. Students whose English language proficiency is no more than marginal, 
,i.e., the ptudent understands very little and produces only isolated 
words or phrases in English. 

II. Student whose English language proficiency is"no more than partial, 

i.e., the student understands a little more than a student classified 
as Level I and can^ccmmuhicate Tn"^Tgli^h^w-rfch» great difficulty* 

III. Students whose -English language proficiency is^greater than students 
classified in Level II, S #e ., the student 'comprehends most of what is 
said to him/her and communicates *" fairly well although his/her* f 3 uenay 
is not comparable to that of Level IV students. 

IV. Students whose English language proficiency is adecruate, i.e., greater 
than students classified in Level III. The sjtudents comprehend and— 
. communicate adequately but their fluency is not comparable to/that of 
native English-speaking peers* ' — S 

V. Students whose English language proficiency is equivalent ?o that of 
their native English-speaking peers* 

% 

Instruct ional Needs Categories * 

Category A: Speak4 and understands little or no English and needs 
almost all instruction in her/his home language. 

Category B: Speaks and understands some English, but needs about half 
his/her instruction in the home langauge. 

Category C: Speaks and understands well enough to participate in . a 
classroom in which English is used most of tHe time; 
receives almost all her/his irfstruction in English. 

Category NP; This pupil's language ability is equivalent to that of 
her/his native English peers and she/he can perform 
^adequately in an all English classroom. 

Bilingual endorsement is granted to candidates who hold teacher 
certificates and who have passed both oral and* written examinations in a 
language in addition to English. > 

(See pg, 28 for definition of Category Exit Criteria)* * 



Description of Bilingual Services 



r 



t During Fiscal 1979 more than 25,50© students' received bilingual t 
services in Chicago. The 201 bilingual programs (those serving more than 2Q 
students} were located in all but six of t^e 27 districts throughout the city 
with districts 6 and 19 having' the largest concentration of bilingual 
programs, A total of 2350 studeffts, were identi^ted asTin need of bilingual 
services for which staff were unavailable- Approximately half , of thes^ 
students were in 'schools where there were less than 20 students of the same 
language group. The remaining half, all of which were Spanish speakers, did « 
qualify for bilingual services on the basis of the number of limited English 
speakers per school. An 'examination of the instructional needs categories of 
thos£ students^revealed that the majority were judged by their teachers as 
needing anly limited support services in their native language. Thus, it 
seems that those students in most need are receiving bilingual services, but 
tha*t support* services for students who have achieved some degree of fluency" 
are sometimes cuj^tfiled due to the unavailability of qualified staff. 

Instruction in 16 *lang&iages was provided by approximately 1133 teachers 
of whom 85#{5eTcent werje bilingually endorsed; an additional three percent were 
pending endorsement. There were an additional 41 teacher positions serving .4M| 
the programs with less than 2 0 students from one language #roup, 

Spanish was^ the language of instruction for ninety percent, of the 
students participating in bilingual programs. Instruction was also provided in 
Arabic, Assyrian, Cantonese /Chinese , French, Greek, Indie, Italian, Korean, 
Laotian, Pilipino, Polish, Romanian, and Vietnamese. Tabled provides a 
summary of bilingual programs and staff positions in each district for* fisoal 
1979. Maps 1 and 2 plot the location of Spanish and non-Spanish/ (more' than 20 
students) bilingual programs geographically . Bilingual programs in languages 
other than Spanish occurred mostly in the northern sections of the ci^y, an 
ethnically heterogeneous area. Several new programs were established in" both 
the northwest and southwest regions. Spanish bilingual programs were , 
concentrated in ±he near south and northwest areas and extended north along 
the lake. Districts 17 and 22 of the city's southeast side also had a number * 
of bilingual programs. 
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TABLE 1 - Bilingual Programs and StrfT by District 



'District 
. 1 ' 

2 

3 
• 4 

5 

6 

7 

8 

9 
10 
1 1 
12 
15 
17 



18 



19 
22 
24 
25 
26 
27 
Total 



Number of 
Schools 

8 

7 
17 

6 
11 
28 



ft 

h 



4 
6 
2 
7 
4 
7 
1" 

18 
2 

13 
6 
9 
1 

164 



Number of 
Lan<^uages 

6 

3 

4 

3 4 
. 2 



2 
3 
2 
3 




1 
9 
1 
1 
1 



Number of 
programs 



(Budgeted ) 



(more than 20) Teacher -Positions 



/ 



18 
7 

J 22 
8 
12 
28 
6 
1 
4 
6 
3 
7 

' 7 
8 
1 

18 
2 

28 
6 * 
8 
1 

201 



35 

24.5 
84 . 
18 
86 
321 
17 
3 

'12 

% 

8 
12 , 
21 

; 55 

1 

200 

U 13 
. 74 

58 

50 
2 

1159.5 
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Map 1. Location of schools witlj, Spanish bilingual programs with an^nrollment pf 




Map 2, Location, o f sch ools with bilingual programs in languages other than Spanish 



with an enrollment of 20 
or more pupils* 
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* - The majority of students receiving bilingual services were at the elementary 
level; only 13 percent were at the secondary level* More than 60 percent of 

acres 4-8. 
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FIGUPE 1. Proportion of Students at Elementary and Secondary Levels Peceiving 
/ Pilinaual Services *" 
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Between January and May of 1979 the numbe^ of students receiving either 
biliijgual or ESL services increased by 17 percfent. Students participating in 
^bilingual programs for the -first time accounted\f or nearly 70 percent of the 
'increase. Second -and third~year enrollments also increased by 13 percent and 
13 percent respectively. Fourth-year enrollment increased by one percent , 
while fifth-year enrollment decreased two percent. Assuming the continuity of 
intra-year student identification procedures , the net increase of more than 
1800 first-iyear students in a five-month period suggests a substantial influx 
Qf limited English speaking students from outside the Chicago public school 
system. 'This conclusion is further substantiated by lobking at the enrollment 
dates 'of bilingual program participants* Approximately three-quarters of the 
students begaR in September 1978. Each month there after between 400^200 new 
students enrolled in bilingual programs* At the same time, a substantial number 
of bilingual program participants left the Chicago public schools* *The data 
indicate a steady influx of n^CT students as well as a moderately high degree of 
mobility among program participants. The impact of both of these trends on 
program continuity needs to be examined. 



♦Article VIII , Section 8.01 of the Illinois Pules and Pegulations for 
Transitional Bilingual Education, State Board of Education, July, 1976, 
stipulates that a student of limited English-speaking fluency shall remain in 
the program for a period of three years or until such time as he/she achieves 
a level of English language skills which will enable him/her to perform 
successfully in clasps in which instruction is given only in English, which- 
ever shall first occur. 
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FIGUPE 2. 



Proportion of Students in Bilingual Programs by Nui^er * 
of Years Enrolled * 
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In May 1979, 26 percent of all students surveyed were judged to be in 
category A as compared to 36 percent in the preceding January* The number of 
category B students increased though the percent decreased slightly from 30 
percent to 28 percent. Category C students increased fran 22 percent to 24 
percent. The number of students judged not to be m need of services more 
than doubled* 

\ * 
A similar pattern emerged from language proficiency evaluation of ¥ -: 

elementary students enrolled in bilingual programs* In 'January 38 percent of 

the students were rated, at tne lowest level of English proficiency as compared 

to 28 percent at the lowest level in May* The number of students rated at 

the lowest English proficiency level decreased 17 percent despite a 19 percent 

increase in first-year students. The number of students rated at levels 2-5 

increased though the relative percentage increased only slightly. 
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FICUPE 3. Comparison of January a nn May English Proficiency Levels of- 
Elementary Bilingual Prograr? Participants 
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\ 

The dat^ indicate that the students most needing bilingual instruction 
were its primary recipients. Fifty-nine percent of all elementary students 
enrolled in bilingual proarams had little or only partial fluency in English 
(levels 1 and 2 of a five-point scale), 2 5 percent had barely adeauate levels 
of English fluency; an Additional 13 percent could communicate fairly well in 
English, though their fluency was not comparable to tfreir native English- 
speaVing peers • Only three percent were judged to be totally proficient in 
English. The fact that 82 t percent of those rated as level 1 and 49 percent of 
those rated as level 2 were m their first year of bilingual instruction 
suggests that the majority of students in the lowest ^nglish proficiency 
levels were new arrivals to the Chicago public schools and/or were entering f 
school for the first time. The latter conclusion is further substantiated b^ 
the fact that more than half of all the elementary students rated at the 
lowest English proficiency levels and ir their first year of bilingual 
instruction were four five, or six years of age. 
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Elementary Program Description ** ■* ' * 

Article^ 14^ppf the Illinois Revised Statutes, Chapter 122, provides for 
'bilingual instruction for limiied-English-pr of iciency students in content 
areas as well as the home language, history and culture. In the city of f 
Chicago th^re was a brbad range of bilingual programs designed to meet the 
needs of limited-English-prof iciency students from diverse language and 
cultural backgrounds. Programs varied widely in organizational and staffing 

( patterns, instructional approaches ,and materials. Within broad guidelines, 
most o'f thess f dehors wer^jat the discretion of local or district authorities. 
Three organizational models and multiple combinations were used at the 
elementally level. The Self-contained model accounted* for the largest number 
of* students. In this model a bilingual teacher was. responsible for both the 
English and native language sub}ect areas. A second model, Team-Teaching, 
required a bilingual* and the regular classroom teacher to work together in the 
same classroom for either p half day or for the-, entire day. Students in the 
Pull^Out model received 90 minutes of instruction in the home language from a 
* bilingual teacher and spent the rest of the school day in their assigne<J_^ 

* classrooms with an Englisti dominant teacher*. A fourth model, Departmentalized, 
was used in high school programs and in some upper grade centers. In this model 
pupils received instructioa from a bilingual teacher in specific subject areas 
to include mathematics, science, social studies/culture and language arts in 
the pupil's first language. 

s " - 
^Another area which accounted for a significant amount of the variation 
was the instructional approach employed. Three basic^pproaches were 
identified; S) oral and reading skills in the home langS?^ -were developed as 
a basis for acquiring English 2) the home language was used for explanative 
purposes but literacy was developed or continued exclusively in English. 
3} literacy was developed concurrently in both the home language and English. 

Profiles of bilingual programs in selected schools indicate considerable 
•variations in key areas .(fable 2). There were significant differences in the 
proportion of students from different instructional needs categories or 
English fluency levels as well as the total number of students receiving 
bilingual instruction in each school. The differences extended from schools 
having relatively few limited English students spread out over the full range 
of" ag^ cycles to schools where the bilingual program was almost exclusively 
concentrated in the primary grades. Acknowledging the limitations of 
cross-sectional data, the prof iles *also suggest considerable variation in the 
amount of time a student may spend in a bilingual program. In some schools 
thelmajority of students were in^heir first y.ear*of bilingual instruction 
with only a very reduced percentage in the second or third years. Other 
schools seem to have had mostly two-year programs. Still others appeared to 
have a consistent enrollment over the three ^ars . 

f 
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TABLE 2,. Sample School Profiles hn Selected Variables 



A, Instructional Needs 'Categories v 





School 


A. 




B 




C *' 


NP 








icf% 




28 %"* 




56% 


6* 






p 


10% 




34% 




28% 


28% 








18% 




27% fc 




25%' 


30% 






iJ 


28% 


) 


32% 




19% 


2 1% 










*29% 




9% 


28% 




J 


- 






\ - 

Age 






















* 




t 




School 


5-7 




8^10 




1 1-13 . 


14-16 






A * . 


50% 




31% 




17% 


) 1 

2% 






B 


48% 




31% 




18% 


3% 






c 






50% 




40% 


10% 


\ 




D * 


58% 




35% 




7% 








E 


41% 




33% 




22% 


4% 


I 


if 


* 






4 








1 

/ 








Years 


in Program 










School * 1st 


2nd 




3rd 


.4th 




5th 






















A f 71% 


12% 




14% 


2% 




1% 




B 48% 


46% 




6% 


« 0 




0 




C * 35% 


34% 




25% 


3% 




3% 




D 39% 


38% ' 




21% 


1% 




1% 


* 


E 44% 


32% 




22% 


1 * 




1% 



V 

The range of objectives , the implicit time frames of specific instruc- 
tional strategies , and population differences" are sufficient to ma£e 
generalizations concerning bilingual education very difficult; The impact of 
program variation on student prepress, in particular the relationship of 
specific instructional program variables to outcomes measures, is an area 
which demands further investigation. 
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Despite the limitations *bf the da£a created by program variations, 'a 
general description of the instructional program in terms of the amount of 
time in English is. possible. In May 1979,. 60 percent of the students* 
receiving bili*^ual services received 50 percent or more of their instruction 
in English. This represents an increase from January, 1979. 



FIGURE 4. Daily Instructional Time in English 
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The increase appears to Have occured equally in all subject ar§as. Language 
arts was more likely to be given in English than other content areas. Science 
atad social* studies were least likely to be given in English . though the * 
differences were minimal. J 

FIGURE 5, Percent of English Instruction for Language Arts 
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FIGURE 6. Percent of English Instruction for Mathematics 
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FIGURE 7. Percent of English Instruction for Sdcial Studies and Science 
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It was expected that those students wi'th the least fluency in English 
would receive a greaier portion of their instruction in their native language. 
This expectation was generally confirmed (Figure 8), Seven percent of the 
Category A students enrolled in bilingual programs as compared to 1 percent of 
Category B and C students received 25 percent or less of their instruction in 
English. Sixty-six percent of the Category A students as compared to 33 
percent of the fategory B students and eight percent of the Category C 
students received between one-quarter and one-half of their instruction in 
English. Over half of the Category B students and two-thirds of the Category 
C students received 50 to 75 percent of their instruction in English. 
One-quarter of the C students received between 75 percent to 100 percent of 
their instruction in English in contrast to nine percent of the category B 
students. ** 

FIGUBE 8. Instructional Needs Category by Amount of English Instruction 
70% | 




Daily Instructional Time in English 



j The percent of English instruction per day increased slightly with the 
number of years enrolled in the bilingual program. It is likely that the 
increase is small due to the* movement of students who have been proficient 
in English into all English classrooms. This appears to be supported by the 
sharp decline in the number of students enrolled in bilingual programs 
subsequent teethe first year. 
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FXGUFeS. Mean Instructional Time in English by Years TETnrolled 
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FIGUKE 10. Years in Bilingual Program by Instructional Time in English 
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Figure 10 indicates that the number of students receiving less tlia-n \ 
one-quarter of their instruction in Enqlish represented only three percent of 
the students enrolled in bilingual programs. First-year students are more 
likely to receive' between 25 and 49 -percent of their instruction in, English 1 , 
than second and third-year students. The trend is reversed for those students 
receiving 50-75 percent English instruction* Nearly |one-quarter of the 
third-year students received 25-50 percent English. f yistruction. More than ' — 
half of these students were between the ages of 6 and 8 when more 
instructional time in the native language may be^teauired. It appears that 
English language fluency is a more accurate predictor of the amount of 
instructional time in English than the number of years* of bilingual 
instruction, though there is a moderate degree of correlation between years in 
t program and English fluency. 

In addition to state-funded bilingual services, approximately 10 percent 
of the students received supplemental tutorial services from Title VII support 
teams* Eight percent of the students were also served by teachers who had 
participated in Title VII sponsored staff development programs under the 
auspices of the Chicago Board of Education and/or cooperating universities. 
Eight percent of the students participated in Language in Transition (LIT) , a 
Title I funded activity designed to increase the English language skills of 
students of limited English proficiency. An additional four percent 
participated in other Title I activities* Special reading services/ the 
Intensive Reading Improvement Programs (IRIP) were provided also for 
approximately five percent of the students identified as being of limited 
English fluency. . . * ' 
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Student Achievement ^ * 

Sfhis section examines the achievement of elementary students receiving 
bilingual Services, -^Tdeaily, the measurement of the academic achievement of 
limited English proficiency students should include both English and native 
language measures. A significant portion of the curriculum, particularly for 
students at the* Tower English proficiency levels, is likely to be given in the 
native language. Testing solely in English may severely underestimate program 
effectiveness, ignoring areas of the bilingual students 1 knowledge — areas 
which may be, inadequately mirrored through English instruments. 

Acknowledging the above limitations, two measures of English achievement 
were used. These included the Iowa Tests of Basic Skills (ITBS), administered 
annually to students enrolled in Chicago public elementary sdhools, and the 
Continuous Progress/Mastery Learning (CP/ML) reading and math levels. ITBS 
scores are reported for only a limited number of students receiving bilingual 
services. CP/ML levels, however, were available^for the majority of students 
and are known to correlate reasonably well with? the ITBS scores in reading 
(+.67) and mathematics (+.71). 

Of particular interest, in light of the compensatory character of 
bilingual services/ was the amount of gain students a£ different age and fluency 
levels demonstrated. In addition, the relationship of instructional time in 
English to gains in reading and mathematics was examined. 

Figures 11 and 12 depict the mean ITBS reading and mathematics grade 
equivalent scores for students receiving bilingual services. Differences in' 
"English proficiency, reflected in the assignment of instructional categories, 
appear to be operant forTS%h reading and mathematics achievement. In general, 
students receiving bilingual services performed better in mathematics than in 
reading; the differences in mathematics- achievement a mong th e instructional 
categories- appear to be !J,ess pronounced* than for reading. 
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FIGUPE 11. Mean ITBS Reading Comprehension Scores by "Age and by 
Instructional Category 
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FIGUPE 12» Mean ITB& Mathematics Scores by Age and by Instructional Category 
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yhe academic progress of nearly all bilingual program participants in 
English reading and math was assessed by a series of locally developed 
criterion-referenced tests. Figures 13 and 14 show the mean performance of 
these students by age and instructional category. Comparison of tlje two figures 1 
reveals the effect English fluency had on achievement in both areas. In 
reading, the distinctions among instructional categories were significant and' 
increased with age? in contrast/ the category distinctions for math while 
operant were minimal. 

Examination of the preceeding figures reveals. that students receiving J » 
bilflrngufel services achieve, in general, several years below expected grade f 
level in reading and mathj The transitional nature of the bilingual program is 
a factor contributing to this phenomenon. As students become able to function 
in all English classrooms they no longer receive bilingual services. Once 
students function at or near grade level they usually do not participate in 
state-funded bilingual programs. 

Gain scores are more useful for the purpose of program evaluation*. Stu- 
dents receiving bilingual services gained on the average 7.4 months in reading 
and 8.0 months in math on the appropriate subtests of the ITBS. The reading and 
math gains followed a pattern similiar to the grade equivalent distributions. 
Overall, students gained slightly more in math than in reading. This was 
particularly true for students 10 years of age and older. Category B students 
showed the most gain in both areas (Table 3). Figures 15 and 16 depict the 
average reading and math grade-equivalent-month gains of students receiving 
bilingual services in comparison to Title I and city-»wide averages. As 
compensatory education programs, Title I programs provide the closest, though- 
distinct, ccmparisorr population by which to gauge pe effectiveness of bilingual 
or' ESL programs . 



TABLE 3* ITBS Reading and Math Gains (months) by Age and Instructional Category 
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Reading Mathematics 



Age 

8 
9' 

*• 10 
11 
'12 
- 13 



Reading Math 
| Total | Total ' 



7.0 I 8.3 I 6.0 
6.9 I 7.6-' | 7.2 



9.2 



■h 7.1 I 



8*.3 I 7,3 
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7.1 | 9.5 



i 7.4 ! 



6.9 | 6.9 I 6.8 I 

.I, I - I 

7.3 | 7.3 

7.3 



6.8 
9.1 
5.7 
7.3 
10.0 



B I 
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6.8 I 
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9.1 I 

- I 
8.5 | 
I 

9.4 | 
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V.8 ' I 



C I 
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6.3 | 
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7..TOI" 
"I 
8.1 | 
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7.1- I 
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9.7 I 
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1 1 .,3 | 
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FIGUFE^14. Mean CP/ML Levels in Mathematics by Age and Instructional Cateqory 
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FIGUPE 16, Mean Mathematic Gain {ITBS) by Age 
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In reading; eight and nine-year-ol&bilingual students gained more than either \ 
comparison group. Reading gains for bilingual or ESL program participants were 
above those of Title .1 participants though below city-wide averages; (13-year 
olds w^re an reception and were likely caused b£ a greatly reduced sample size). 
Mathematics gains for students receiving bilingual services were generally equal 
to or higher than city-wide averages with the exception of eight ano\nine-year- . 
olds. Bilingual program participants gained on the average 7.5 months in 
reading and 9.7 months in mathematics "as measured by the CP/ML levels. CP/ML 
reading and math gains followed patterns similiar to ITBS ^ains (*£afe^e 4), 
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TABLE 4. CP/ML Reading and Math Gains by Instructional Category 



INSTRUCTIONAL CATEGORY 
A 
B 
C 

TOTAL 



READING GAINS (Months) 



7. 1 (N = 5875) 

8.5 (N = 2486) 

7,8 (N = 1104) 

*7.5 (N = 9465) 



MATH GAINS (Months) 
10,0 (N = 6252) 
8.8 (N = 2697) ' 
9.5 (N = 1620) ■ 
9.7 <N *^0,565) 



Table 5 displays reading and math gains for bilingual program participants 
by age. Gains tended to increase wit,h age. Age cycle six students gained 
approximately a half year in reading* Considering that most entered school with, 
little or no knowledge of English, little English reading gam would be 
expected. Older students demonstrated the* most gain, some surpass ing. the 
expectation of a month-for-month gain (10 months). t + 



TABLE 5. CP/ML Reading and Math Gains by Age 
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Age 


Reading Gain (months) 


Math Gain {months) 
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4*8 


8.6 
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6.3 


9,2 


8 


7.2 


9*4 
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7.9 


9.6 


10 


8.8 


10,2 




1 




m * * 
1 t 


10.3' 


10. 1 


12 
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' 11. 1 „ 


12.2 


13 


11.3 


% 13.7 


t 


(N = 9,467) 


" (N = 10,642) 
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These data indicate that bilingual program participants were learning to 
read in English and making progress equal to that of- students Enrolled in ether 
compensatory education programs. For most students, this task mcludediJ.earninQ 
to understand and speak English ir addition to' acquiring basic reading skills. 
At the same" time, the rate of progress of .program participants m a major 
content area as mathematics wasymamtamed at expected levels. 

The amount of instruction m English has often been cited as a key 
variable which affects the differential achievement of Umite4*English-speakmg 
students. An attempt was made to discern the relationship of the number of 
periods per day of instruction in English to the amount of gain demonstrated on 
the ITBS in both Reading Comprehension and mathematics* 

Few students received less than two, periods per day of English instruc- 
tion. The number^f students participating in bilingual programs who were 
receiving more than six periods per day in English was aLso limited, thus 
reducing the number of distinctions possible. The correlation coefficients of 
mathematics and reading gains on the ITBS to periods of instruction in English 
were- also lower than expected, +,0€ and + .07 respectively* 

Instructional time in English contributed less than one percent to the 
differential gain of students m mathematics when the variance in gain scores 
due to age and language proficiency were held constant. For reading, the amount 
of variance due to English instructional time was slightly higher but still less 
j^rfhTt two percent. In other words, only a very small amount of the gam in 
reading and mathematics on the ITBS could be attributed to an increase in the 
amount of instructional time m English. These results suggest that other more 
powerful factors account for the differential achievement of limited English 
fluency students. These might include sc/cioeconcmic factors, native language 
fluency, previous educational experience, instructional strategies, and school 
and classroom characteristics. ■ * w 
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A major goal of the bilingual program m Chicago is to prepare limited 
English .prof iciency students to participate fully in the regular English 
curriculum offered by the schools. This goal encompasses both the development 
of an English lang€a^5^on\petence as well as the parallel conceptual development 
of students in all other \vbject areas, 

4 A principal gauae of the effectiveness of a program in attaining this goal 
is the academic progress of the students. A secondary measure is the amount 
of movement from one instructional category to the next and finally into the 
regular English classroom program. This second measure, however, can only be 
a valid indicator of program effectiveness when it is strictly linked to 
academic achievement. * 

Beginning in the Fall of 1979 new criteria were established for the 
movement of students from one instructional cateqpry to the next. These 
reflect the relationship of instructional category placement to academic 
progress. They implicitly recognize, that the kind of instructional program' a 
student needs depends to a great extent on his (her) reading ability to , 
comprehend materials written in English. 

Exit Criteria for Elementary Students^ 
% * * 

* "n 

.Children exit from category A to category B when. they have 
mastered the continuum of skills in reading through level 
D . 

.Children exit from category b to category Cwhen th^ are at 
mastery level in reading in "English for their cohort ag^ 
* group on city-wide data .Children who are reading in 

English at one^ standard deviation below local norms -for 
their age cycle may also be exited from B to C based on 
additional information contained in the child's profile... ) 

.Childrelf exit from category C to the general program of 
» * instruction without support when t.hey are at mastery 
* level for their age cycle according to national norms in 
reading in English. Children who are reading in English 
at one standard deviation below national norms for their 
age cycle may also be exited from C to "No Program 11 based % 
upon additional information contained in the^child's 
prof ilfe. . . (pg. 3-4) 



7 Dif f erentiated Curriculum:, Instructional Design—Elementary Schools . Board 
of Education: Chicago/ 1979, pg. 3-4. 
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Table 6 reflects these criteria depicting the total upward movement 
between instructional categories by elementary school students during the 
1973-79 academic year. 

More than two-thirds of the students receiving bilingual services 
progressed to a higher category. The greatest amount of movement both in 
numbers and percent was experienced by those students with the lowest English 
proficiency. As would be expected, the greatest amount of movement occurred 
between adjacent categories. Few students would be expected to move from 
category A to 'the regular program (NP) during the course of a single year. 



TABLE 6. Inter-Category Movement of Students by Instructional Category 



Percent of Category- A students moving to Category B 

c' 



NP 



67% 
16% 
4% 



Total 



Percent of Category B students moving to Category C 

NP 



88% 

30% 
11% 



Total 

Percent of Category C students moving to Category NP 
Total percent of inter-category movement 



41% 
20% 
66% 



In comparison to w the movement demonstrated by the category' A students, 
the proportion of category B and C students moving to a high^fttcategory was 
smaller. . An examination of the task of moving from category B to^C^and* from C 
to NP may help elucidate this phenomenon* Exit from category A requires that 
a student master the equivalent of first-girade English reading skills. 
Movement out of category B, however, requires minimally tha.t a student read in 
English within a standard deviation of his cohort age group. An eight-yeas- 
old would have to gain approximately one-half year in English reading to move 
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the equivalent of three years in English reading to move to category C, an 
awesome and unrealistic expectation for a year's time frame. To exit to the 
regular English curriculum program (C to NP) younger students would be 
expected to gain the .equivalent of one-hal£ year in English reading, older 
students, one year. 
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TABLE 7. Minimum ^English Reading Gain Required to Move Between 
Instructional Categories 



Age 


B to C 


" C to NP 




(Years) 


(Years ) 


8 


1/2 ^ 


V2 


9 


1 


1/2 


10 


1 1/2 


1/2 


>1 


2 


1 


12 


2 


1 


13 


3 





The amount of movement ybet^Uft instructional categories expected during 
an academic year must coincide wWh realistic possibilities. Achievement data 
have shown that students receiving bilingual services gain seven to eight 
months in reading and 8*10 months in math, gains comparable to those of other 
compensatory education programs/ and in the case of math, equivalent to 
city-wide gains. However, few could be expected to gain the equivalent of 
•several years in reading to move from category B to C within one academic 
year . 

The number of years enrolled in the bilingual program is another 
indicator of the movement of students ( to the regular English curriculum,. 
Table 8 depicts the proportion of students enrolled by years " in 1 the program 
for 1974, 1975 and 1979'. _ , >T 



TABLE 8, Percent of Bilingual Program Participants by Years Enrolled 

^ * . 1974 1975 1979' 

< - 

1st 48.7 4 44.8 52*0 

it 

2nd i 39.8 35. 1 30*9 

3rd 9.4^ 15*0 • 13.6 

* 

4th + 2.1 5. 1 3.5 

100%- * 100% 100% 

(N * 10,746) (N = 1161 - Sample) (N - 23,363) 



The low incidence of fourth and fifth year enrollments indicates that 
students are indeed moving into the regular English curriculum. 




High School Program Description 

Bilingual services were extended to approximately 2,600 high school _ 
students in 20 high schools, representing roughly 13 percent of all students 
receiving bilingual services. There were 31 separate (more-than-20 ) bilingual 
programs with 131 budgeted teacher positions. Instruction was provided in ten 
languages— including Assyrian, Cantonese French, Greek, Eefelian, Korean, 
Laotian* Polish, Spanish, and Vietnamese . 

Ninety-two percent of the high school students surveyed in May 1979, were 
born outside the continental United States, in contrast to nearly 60 percent 
of the elementary school students, More than half of those students were 
born in Spa nish- speaking countries* When only bilingual program participants 
are considered, the percentage of students born outside the continental United 
States may be somewhat higher. 

Ninety-seven percent of the hi^h school students had been, receiving 
bilingual services for one to thr«e years* A breakdown of the data revealed 
that 52 percent were Sn the first year, 31 percent in the second year, and 14 
percent in the third year. This pattern was identical to that of the 
elementary school students receiving bilingiial^services . 

Between January and May the number of , high school students receiving 
bilingual services increased by 12 percent. The increase at the ' ^ementary 
level '^as higher. ' ^ 

Those in the first* year of bilingual services tended to exhibit the 
lowest English proficiency levels. Hie majority of second-year students (75 
percent) were rated in the mid range (levels 2 & 3), while 69 percent of the 
third-year students were in the mid to upper ranges (levels 3 and 4)* The 
sharp decrease in the number of students rated 4 or 5 on the English 
proficiency scale suggests that as the students attain adeauate or nearly 
adeouate levels of English proficiency they no longer participate in bilingual 
'programs* This interpretation is corrobarated by *tfte* steady decline in each 
year's enrollment (Figure 17). ' 
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FIGUFE 17. Years in Program by .English Proficiency 
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Most high school students (76 percent) 'receiving bilingual services wer§ 
either\f reshmen or sophomores, 81 percent of all freshman were in their first 
year of bllingua3T~instruction, another 12 percent were 'in their secoad year* 
The enrollment pattern at subsequent years conf i£ne£ .the freshman year entry 
point of most students into bilingual programs* ^ 

Figure 18 depicts the. English language- fluency levels of limited English 
proficiency high school students enrolled in bilingual programs.. More than 
half of the students were at the lowept English proficiency levels* An 
additional 35 percent exhibited barely adequate English proficiency. Only 12 
percent of the students had native or near native command of English. Between 
January and May the number of students rated at the lowest proficiency levels 
declined while those rated at the mid to upper levels increased. 



S 



ERLC J 



32 



3i) 




FIGURE 18., -English Proficiency of High School Students Receiving Bilingual Servic 
B0%| 

CO 

' s: 
V m 

' . o $ 

o 

as -h 
- .o 

c 

> 

U -O 
0) 0) 

a. as 

Low 

English Proficiency 

' It is clear from the data that tim- students receiving 'Bilingual- 
services at the high school level were those in most need. In* addition^ the 
students receiving bilingual services tended to be new arrivals to the Chic§g6 - - 
, public schools as evidenced by the overwhelming number of students born outside 
the continental United States, the ^pw English proficiency levels, and the high' 
concentration of students in the first and second year of bilingual instruction* 
The data also suggest that few students coming from bilingual programs at the 
elementary level received bilingual services at the high^ school level. 

A comparison of the estimated amount of instructional £ime in English and 
the native language of high school students receiving bilingual services 
showed a slight increase Jtn the amount of English between January and May, The 
, increase in English usage oocurred fairly evenly over all subjeet areas except 
language arts, suggesting that English language usage increased throughout 1:he 
year. Virtually all of the students received fifty percent or more of their 
language arts instruction in Eng t lish < including 57 percent wljo received nearly 
all their language arts instruction in English. *The proportion of high school 
students receiving at least half of their language arts instruction in English 
was significantly higher than elementary students* Current research supports 
the_ appropriateness of this approach citing the higher linguistic competence 
and literacy levels in tfre native language of oMer students as factors which 
permit a higher concentration of instruction in the second language.^ Content 
areas as social studies" and science were slightly more likely to be given in 
the native language than mathematics, though for both, over 70 percent of the 
students reeefived at least half of social studies and science in English. 



^Cummins ,\ p « 229 . 




In addition to bilingual "services/ approximately eight percent of the 
students participated in a reading lab designed to g;Lve intensive practice in 
specific English reading skftl* to those students determined to need 
additional help, ^ • 



Achievement 



Achievement data on standardized tests were unavailable for high school 
students as were Continuous Progress reading and math levels. Grade-point 
averages of the students receiving bilingual services showed that nearly -krflf 
of the students (48 percent) achieved at a C level; 27 percent at A & B; 
and 25 percent at D & F„ This distribution of grades meets normal expectations 
with three quarters of the students achieving at or above a passing level. 

Between Jajiuary^and May teacher evaluation of English language 
proficiency levels of students reofeiving bilingual services showed a decrease 
in the percentage of students at t^e lower proficiency levels and a comparable 
increase in the percentage of students at the middle level, The number *of 
students with native or near native English proficiency remained relatively 
constant. It must b* noted that during that same period there was a 10 percent 
increase in the first through third-year enrollments/ of which over 90 percent 
occurred in the first two years. This factor would be expected to moderate 
'increase in English proficiency (Figure 19}* 

FIGURE' 19. Comparison of January and May English Proficiency of High School 
Students Heceiving Bilingual Services ' 
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Special Education Services ' > 

In May 1979, approximately 1600 students from homes where a language other 
tV»an English was spoken were identified as in need of special education 
services. *Ninety~six percent of the students identified were receiving special 
education services. Nearly one-fourth of these students were also enrolled in 
a bilingual program of instruction Tor special education stude'ntsy placement 
within a bilingual' program i§ contingent upon the student's Individual 
Educational Program (I.E. Pi) which is' developed based on the recianmendations of*' 
a multidisciplinary staffing. -The English proficiency of ' approximately one-* ^ 
third of the students in y need of ' special^education services was rated at levels 
1/ 2/ or 3; the ^remaining two-thirds were j'udged to be adequately proficient in 
English. ' 

The number of special education students receiving bilingual services 
increased between CEanuary and May. , Five percent of the special education 
students with English fluency levels 1, 2, or 3 received special education 
services 'from an* endorsed bilingual teacher, and 39 percent of the same 
students received services from a bilingual '.aide . Less than one-fourth of the 
Students receiving bilingual special education services from an endorsed * 
iklingual teacher were judged to be of limited English fluency. A bilingual 
aide was available in nearly twice as many of the cases, but as *in the previous 
instance, less than half of the students were judged to have limited skills, in 
English. The data 1 point to, a need for the greater availability of bilingual 
special education services, as well as a redistribution of* services to meet the 
needs of the^tudjSpts with the least English- prof iciency. 

- ' • \ ' ' < 

Special education services encompassed a wide variety of handicapping 
qonditions. The' most freouent of these were Moderate Learning Disabilities 
(MLD), Speech, Primary Efducable Handicapped (EMH) and Trainable Mentally 
Handicapped (TMH) accounting for over 60 percent of the students. MLD and 
^peech services were usually supplied through ^a resource teacher; Primary EMH 
afcd TMH services tery3*4^to be given by a single teacher in a self-contained 
classroom. 

I 

The mean number ofV periods'^? da^\ of instructional time in English for 
spe'cial* education studenTfs\^'cei^lng biMngual services was four, or slightly 
more than half of the day iV-Eirglish. *Ate the students 1 ' English fluency 
increased so did the amount of Etvglish instruction. No appreciable differences 
were discerned 'among the various content, areas. 
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Bilingual Classroom Observation Survey 
Summary of Pesults 

£ total, of 153 classrooms were observed by the Sitaf f o£ the Bilingual 
Unit: of the Department of Research and Evaluation during the months of 
February through May, 1979. The mean number of minutes per classroom visits * 
was 28. The mean class size was also 28 with 51 percent of all classes 
visited having 28 -or fewer .students . The mean aae of students in these 
classrooms- was eight years, with 51 percent of the students between the ages 
of five and. seven, and the- remainder between, the ages of eight and 14. The 
age distribution of the sample was similar to \hat of the total elementary 
bilingual program population. ' 

• * 

Number anc' type of teachers 

Of the classrooms observed, 56 percent had one classroom teacher, 36 
percent had two adults supervising," and eight percent had three or more adults 
in charge of the class. All classrooms had at least one regular teacher, 29 
had teacher aides, five had student teachers, and three had other adults'in 
the classroom, of the classrooms with one regular teacher, 21 percent had a 
■teacher aide. 



^ Classroom characteristics 

*§s shown in Tables 9 and 10, most of the a37ssrocms were of the self- 
contained type (74 percent), and located in regular classroom facilities, {85 
percent). The most freauent type of instructional grouping was that of the 
whole class receiving instruction (41 percent of the classes), followed by 
, small group working with teacher (31 percent), and part of class receiving 
instruction (30 percent),* The instances whereby the whole class was working 
independently accounted for only 12 percent of the classes, and those where' " 
the whole class was working with a teacher aide accounted for only 10 percent 
of the responses. 




TABLE 9 
Program Model 



Self- Contained 
Team Teaching 
Pull-Out • 
Departmentalized 
Other 



Percent of' Cases 
74 
14 

* 5 

I 

4 
3 



Total Responses — 158 
Total Cases = 153 



r 



Count 
115 
22 
9 
7 
5 



*M*ttipl£ responses allowed 



TABLE 10 
Classroom Facilities 



Pegular Classroom 

Mobile Classroom 

Conference or Small Fooin 

x 

Other Non-Instructional Area 



Percent of Cases 
8! 



Total Responses - * 153 



♦Multiple responses allowed * 

J 



Count 
• 130 
17 
1 
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The instructional content of the classroan observed- consisted mainly of 
languaae arts-Enalish (54 percent of the classes),- language arts-native (30 
percent) and mathematics (22 percent).* *Fhus, the typical classroom 
observed consisted of one teacher, usually without an aide, in a self 
contained classroom with the whole class receiving instruction, either in • 
languaae arts-Enolis*, languaae arts-native, or arithmetic. - * 
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* * 
Bilingual. Classroo m Observation Survev • 

* - Peculiarly certified teachers bad the most, teachina experience? 68 
percent bad six or more years of experience compared to J1 percent of FTB 
certified teachers,. .None of tl^e regularly certified teachers had lees' than 
two years of experience, while^ 34 percent had 15 or more years' experience,' 
FTB teachers bad the* largest percentage of* teaches with <*nly one or two years 
of teaching experience {21 percent), Thus the large majority of air teachers 
had .over two ye«rs f experience. • "* : , * - 

L. \ . " i . • * 

Teacher and teacher a-ide /roles . 

Host of the teachers observed used "Questioning # and discussing" in their 
classrofsn (£4 percent).* The next most - frecuent methods used were "answering 
.and assisting" (68 percent), and "show and tell) demonstrating" (63 percent) 
and" "supervising apd. directing" 'C 53 "percent) * -"Praising" (27 percent) and 
"disciplining" ^19 percent) were used' least by teachers* Most 6f the 
teachers used eclect ic w approaches to * etching, with student participation 
more predominant than teacher criticism. The most frequently mentioned' 
responsibilities for the teacheif aides were reinforcing instruction (41.3 
percent) and tutoring (30.4 percent).* * 



Language use % 

* ' k l 

1 * 

The amount of English used in the classrootn was -fairly evenly distributed 
(see Table 11 )• In one~fou£th of the classrooms obaerved 6nly English was 
psedi'tKese were primarily English language arts clashes an8 sonte mathematics 
classes. The mean percent of instructional time in English observed for, all 
classes was over 50 percent for all content ar£as except native language arts 
{31 percent) and science (44 percent.)* * .* ' • 

Teachers were a£ked to estimate the percentage of English used daily in 
the classroom (Table 12). »The majority of teachers (54 percent) used between 
one-third and two-thirds English daily; one-third used over 75 percent 
English , and only 13 percent used less than 30 percent English, The mean 
percent English used was 61.3. However, 20 percent of the teachers stated 
that thevused 100 percent English in their classrooms, so percentages were 
also calculated without these classes. The mean percent English is reduced to 
51 percfent without the 'all English classes included; 72 percent of these 
classes used at least 50 percent .English. Thus, even discounting the all 
English clashes , most teachers reported using at least as much English as the 
student's native language. l 



Itiple responses 
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TABLE 11 



Percent of English used by Teachers 
> 



0 - 35% 
36 - 60% 
61 ,-' 95% 
100% 



Percent 

25, 2 
21.9 
26*5 
26.5 



M = 151 

TABLE 12 - 

- Teacher Estimated Percent of Daily English Use 
* * Percent 



0 - 35% 
36 - §0% 
61 - 9^% 1 
100% 



14.4 
41. 1 
24*0 
20*5 

N = 146 
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Distribution of Students by Instructional Needs Category 

Teachers were £lso asked to report the percentage of g^idents in their 
classrooms from each instructional nee<3fc category. Few classes had more than 
50 percent category \ students (26 percent) , 22 percent had over 50 percent "B" 
students, 7.9 percent more^han 50 percent "C" students, and 12.9 percent with 
more than 50 percept \"NP" students. Most classes then, were not comprised of a 
majority of students at the same language proficiency level. In fact, only 
three classes had 100 'percent students ,>from a single instructional needs 
category. ' \ 

However, classes did fall into two major groupings: (1) "A, B^ 
classes — those classes toit'r 50 percent or more "A" students, or/50 percent or 
more "B" students, or 5 0 percent or more "A" and "b" students?/ (2 ) "C, NP" 
classes — those classes with SO percent or more "C" students, or 50 percent or 
more "NP" students, or 5p per'cent or more h C" and* "NP" students. Sixty-seven 
percent of all classes f**ll into the "A, B" category, and 33 percent were in the 
"C, NP* category. The distr ibutioiQ *?oes differ slightly when all English 
classes are excluded; far , these^ classes, 76 percent are "A, B" category, ''and 24 
percent were in the'"C, category. Of all the English only classes, 33' 

percent are "A, B" and 67 percent are "C, NP" classes. Although 'these 33 percent 
*A, B* classes in which only English is used represent only nine classrooms, 
they point to possible deficiencies that need to be studied further* However, 
it must be noted that the d\ata are unclear as to whether the limited English 
students (categories A, B, knd C) who were observed in all English classrooms 
were receiving some form of bilingual services from personnel other than the 
teacher present at the time., 

The mean percent of • time that the teachers used English for* the two types 
of classes was also calculated; the mean for the "A, B" classes was 56 
percent, and that for the "C, NP" classes was 70 percent, when the all 
English classes were excluded, the means were 51 percent for the w A,^B fl classes 
and 63 percent for the "C, NP" ^classes . These rough measures of teacher 
language use indicate that teachers do differentiate their English language usage 
based on the instructional needs of their students. However, it is also 
apparent that varying levels of students* English language proficiency within a 
single classroom make it difficult for teachers to gear their language use to 
the needs of all students. 

. j 

In order to measure the magnitude of any relationship between teacher's 
English language use and students' category placements,' Pearson correlation 
coefficients were calculated for teacher's daily use of English with the 
percentage of students in each cateaory per classroom. The coefficients reveal 
that the percentage of "A" students in a classroom was the [better predictor of the 
amount of English used than are any of the other three categories, "B, C, or NP" 
(Table 13). The more "A" students per class, the less English used by 
the teacher. The percentage of "A" students was also the only category which had 
a negative relationship with the amount of English used* that is, as the 
percentage of students in any of the other categories increased, the amount of 
English language used was more likely to increase than decrease* Tfre fact that 
the percentage of "A" students was more likely to influence a teacher's language 
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use than the percentage of any other category of students can perhaps be 
explained by the fact that if the students in a classroom all have the s^ame* 
native language background, teachefs will gear their language use to that known 
by all students. That is, "A", students are not likely to know any English, but 
"SP" students may know the native language of the "A" students as well as English* 
Further research is needed in this area in order to determine if students 
instructional needs are actually being served , particularly for .students in^a 
classroom with students/with different Fnglish language needs'* 

< 

TABLE 13 

Correlation of Instructional Category to Percent of 
Daily English In&truetional Time r 

% Students in 
each category . 
* * • 

A 

B 

C 

HP 



% Daily English 
Instruction 
N = 131 



-*60 
,11 
•28 
♦ 33 



Native, 

English Language Proficiency 

Observers also rated^teachers language proficiency in both English and 
native language on a scale from 1 to 5* Teachers proficiency in both languages 
was generally rated high. ' The mean English rating was 4*7 and that for the 
native language use'd w$s 4.6* These means were relatively similar regardless 
of teacher experience or 'certification, or amount of English used in the 
classroom* • % 

/ > 

4 

English Reading Groups % »_ 

Almost all of the classrooms bad at least one reading group in English as 
well as the students 1 home language; 6*5 percent had no English reading groups, 
6*7 percent had no home language readina groups* The large majority however had 
three or more reading groups *in both English (79 percent) and home language 
( 68 percent) * 

The English language approach used in teaching^ Filfcjlish language arts in 
most of the classrooms was a ^reading series ,(82 percent) and TESL (68 percent),* 
Only 30 percent of the classrooms used the Intensive Peaking Improvement Program 
(IPIP) service. Approximately 84 percent of th& # teachers charted student progress 
using CP/ML 'cards* Eew used .native language levels' CP/ML (18 percent) while" 48 
, percent used individual learning plans. 

♦Multiple responses allowed 




Summary of Bilingual Teacher Questionnaire Results 

Pi. vOtal of 419 questionnaires were returned from 93 different schools, 
representing a sample of more than a third of the total number of bilingual 
teachers and schools with bilingual programs. The majority of , teachers taught 
in a self-contained program (59 percent), with most of the remaining teachers 
divided^ eoually among team-teaching programs (14 percent) , departmentalized 
programs (13 percent), and pull-out programs (14 percent). Only three of the 
total number of teachers taught in a full-day integrated program. This 
distribution differs from the 1978 sample in that the percentage of teachers 
in a team teaching program decreased by almost half from 23 percent to 14 
percent* While those in self-contained models increased from 49 percent to 59 
percent. Other differences cannot be ascertained -since the categories used 
were slightly different in 1978. 

Most teachers ir the sample were certified at the primary (53 percent)* or 
intermediate levels (48 percent). Only 32 percent of the respondents were 
certified at the secondary level. Most of the teachers werle bilingual endorsed 
(96 percent), and 71 percent have had three .years or mere of bilingual teacher 
experience. The mean number of years of bilingual teaching experience is 3*9. 

At every level of 'teacher certification (primary, intermediate, secondary), 
two-thirds or more of the teachers had three or more years of bikingual teaching 
experience. Teachers in self-contained programs had the highest mean years of 
bilingual teaching experienc^ (4.2), followed by teachers in departmentalized 
programs (3*9), team- teaching programs (3*5) and pull-out programs (3*2). The 
highest percentage of teachers with less than two years of bilingual experience 
was for those in the pull-out program (45 percent) ,^nd the lowest was for those 
in the self-contained program ~(23 percent)^ Thus, teachers with, the most exposure 
of students on a daily basis were those with the most experience in bilingual 
teaching* 

The large majority of "teachers certified at tfte primary a&ld intermediate 
levels were in the self-contained bilingual program (64 percent 63 percent 
respectively), compared to 3$ percent *of the seeondary^certif led teachers. A, 
substantial number of the secondary teachers were in the departmentalized 
program (34 percent), with 16 percent in ufc^ pull-out and «12 percent in the 
team- teach ina program* — 



*4 



*Multiple responses allowed 
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Language Use 

Only nine percent of the teachers indicated that their- weekly use of 
English in the classroom was less than 20 percent. The large majority of 
teachers (75, percent) used English at least 40 percent of the time; of those 39 
percent used English a€ least 60 percent of the time and over a third (35 
percent) used English about eoually with their native language. 

Teachers certified at either the primary or intermediate levels reported 
similar amounts of language use; over one-third used over 60 percent English, 
compared "to 42 percent of the secondary certified respondents. The primary %nd 
intermediate teachers were more likely to use both language equally than were 
secondary teachers who used either slightly more or slightly less English. 

Teachers with five and six-year-old students were most likely to use both 
languages eaually. Teachers with seven to thirteen-year-old students were more 
apt, to use slightly more English, and teachers-with *14-year-olds reported using 
slightly more home language. Except for teachers of 14-year-olds, no more than 
one-*thj,rd of the , teachers used less than 60 percenF^rri their^l«srooms . ' 

Virtually all of the teachers^ rated their English language proficiency as 
"good" (31 percent} 1 or "excellent" (67 percent), with the remaining two percent 
self-rated as "fair." Over two-thirds of the teachers rated their non-English '- 
language profibiency as- " excel Itnit; 1 '{71 percent), 27 , percent as "good," and only 
two percent as* "fair." \ . 

No major differences, occured in English or native language proficiency among 
teachers certified ;at different levels. Teachers certified .at the intermediate 
level had a slightly higher percentage rated as excellent in English (93 per- 
cent), as compared to primary certified teachers (63 percent) and secondary 
certified teachers (68'percent) . The percentages were virtually reversed for 
native language^ proficiency, with secondary teachers having the highest 
percentage of excellent rating (74 percent) ( compared to 70, percent qf primary 
certified teachers and "74 percent of -intermediate certified teachers. 

* ' 1 




Teacher Language Proficiency and Language Use 

Teachers who rated their English language proficiency as "good 1 ' were 
slightly less likely to use as much FngHsh in the classroom as teachers who 
rate their English proficiency as ."excellent." Forty-five percent of the latter 
used English at least 60 percent of the time, compared to 31 percent of the 
former. However, over 70 percent of both groups used at least 40 percent English 
per week, / i 

* . - I 

• i * » 

On the .other hand, teachers who . rated £heir native language proficiency as 
"good" were slightly more likely to use more English in the classroom than 
teachers who rated -their native language , as "excellent." Thirty^-fiye percent of 
the latter used English at least 60 percent compared to 48 percent of the former. 
Seventy and 80 percent of the "excel lent * and "good" native speakers, respectivly, 
used at* least '40 percent English, TOus, English and native language proficiency 
may' play some role in determining amount of 'classroom English tfse , but it is 
impossible to confirm such a relationship until both the English language 
proficiency of the students and the type of program are known. It is likely that 
these latter factors are critically important in determining the amount df English 
used in the classroom. Further investigation of these variables is needed in 
order to ascertain if language proficiency in either English or native language is 
a consideratior in the assignment of personnel to specific programs and models. 

Teachers wete also asked to indicate which language they were most likely 
to use in a particular situation, using a scale from 1 to s] with 1 eaual to 
"onl^ native," and' 5 ecmal to "only English"^ use . Thus, a mean, greater than 3 
indicates greater English use and a mean less than 3 indicates greater native 
language use. t ^. 

The greater amount of English use was found for three commands; "asking to 
line up" (3.3), "telling to put things away," f3.3), and "telling to be ouiet" 
(3.1) # All of the other situations have means between two and three. The 
lowest means were for»the teaching of subject matter; "teaching science" (2.5), 
"teaching social studies" (2.6), 'and showing a math problem (2.6), and for 
telling the students to get their parents permission for something (2.5), The 
mean of the remaining item, "telling students" to pay attention," was slightly 
higher at 2 .8. . » 

Therefore, when ^teaching subject matter, teachers were somewhat more likely 
to use the students' native language than English, but no language was necessarily 
preferred for every command . 

The" same pattern of language use held true within categories of overall, 
language use. The meins for teachers whose English language use per week ranged 
between 40 and -50 percent were virtually the same as those just reported. The 
means were uniformly higher for teachers whose overall English language use was 
high (between e\l and .100 percent), and the means were uniformally lower for 
teachers whose overall English language use ranged between T3 and 39 percent. In 
other words, the differences in situational language use were similar reaardless 
of teachers overall language use. The values* of the means varied, not the 
pattern- of differences. 



Teachers were also a'sked to indicate on a scale from 1 to 5, hpw much of 
a problem they have had with a series of items (1 = minor problems, 5 = major 
problem). Table 16 displays the items in their relative order of severity. 

- . f * * 

"The items that were the least problematic for teachers were '"lack Qf 
teacher cooperation" and M lack of administrative support," with means of 1.8 
and 1.9 respectively. Thj* next highest means were concerned with student "and 
classroom characteristics: "wide age range" (2.1); "student transiency" 

(2.4) , and "class too lar£e" (2,5). The next highest means were concerned 
with a wide range of issuis; "lack of parent interest" (2.6); "lack of an 
aide" (2.6); insufficient supplies" (2.7) wide English proficiency range among 
students: (2.8), and "too much testing" (2.8). The two items with the highest 
means were "wide ability range" (3.3), and "too many Questionnaires and forms" 

(3.5) . 

The four items that were most problematic then, were basically of two 
types: (1) student characteristics-wide ability range and wide English 
proficiency range; and (2) administrative tasks-too much testing and too many 
questionnaires and forms. The former problem is undoubtedly exacerbated by 
the*latter. Incorporating the needs of a wide range of students is necessarily 
time consuming and difficult, so that any additional time spent in testing and 
paperwork makes these teacher jobs even more difficult. 

/ * 

TABIB"14. Problems Cited by Bilingual Teachers — — 





Kank Order g 


Problem 


1. 


Too many questionnaires. 


3.5 


2. 


Wide ability range 


3.3 


f 3. 

J .4. 


Too much testing 


2.8 


Wide English proficiency range 


* 2.8 


5. 


Insufficient supplies 


2.7 


6. 


La*ck of an aide 


2.6 


7. 


Lack of parent interest 


2.6 


8. 


Class too large J 


2.5 


9. 


Student transiency 


2.4 


10. 


Wide age range 


2.1 


11. 


Lack of administrative support 


1.9 


12. 


Lack of teacher cooperation 


1.8 



The instructional model in which the teachersUorked also affected their 
definition of problem §. Teachers "in team-teaching situations cited large 
class size as important but were less' concerned about a wide age range. 
Teachers' in pull-out and departmentalized problems indicated that insufficient 
supplies were a problem of moderate concern. Those in pull-out models also 
cited wide age range as a difficulty more often than those in other models but 
were leadt concerned with large class sizi. J * 



There were minor variations in *the ratings of mean seriousness of problems 
among all teachexs in various program model types*. Overall, however, the 
problems most teachers encountered clustered around wide ability and English 
proficiency ranges and^ administrative tasks (Questionnaires, forms, testing) 
apparently considered peripheral to the instructional process, To* a lesser 
degree a lack of resources, both staff and supplies, were cited as troublesome 
areas. 

/ 

While some of the problems cited- are common to a majority of teachers ■ 
throughout the school system, Iwide English proficiency range seems to be a 
problem which affects to a grater degree teachers in bilingual programs, and 
one which must be considered when making organizational decisions concerning 
b^ingual education programs. 
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* During Fiscal 1979 a number of special projects relevant to %he Chicago 
public schools' program of bilingual education were carried out by the 
Department of Pese arch and Evaluation* These included the translation and 
development of the Spanish Criterion-Pef erenced Tests in Mathematics, refine- 
ment of r student placement procedures, updating of the longitudinal data base, 
the translation of the Assyrian version of the Short Tests of Linguistic 
Skills (STLS), and calibration of the Spanish/English version of the STLS. 

The Criteripn-Kef erenced Tests (CPTs) in Mathematics, Spanish edition , 
are a group of instruments which measure the terminal objectives in the 
Behafrior^ Objectives for Mathematics Levels A to V - Elementary School- The 
Criterion-Pef erenced Tests itf Mathematics, Spanish edition were developed in 
order to: 

< 

» fully implement a continuous progress/mastery learning mathematics 

program in the child's native langauge * § 

provide a uniform method of assessing mathematics progress' 
throughout the Spanish bilingual programs within the Chicago 
; elementary public school, ^ 

* assess the Spanish bilingual student's mastery of the terminal * , 
^ mathematics objectives* 

' • . ■ '< \ 

The CJTs in Mathematics cover ten skijLl topics % sets, meaning of numbers, 
place value, operations with whole numbers, rational numbers, measurement 
geometry?* integers , real numbers and probability and statistics* v - 

The CFTs in Mathematics correspond to each of the thirteen mathematics 
levels A through V, as they appear in the mathematics curriculum ^Side's* 
These objectives define skills a student should hav^ b'efore moving on to the 
next mathematics' leyej.. Although all of these objectives are considered 
important, a small -group of terminal objectives^ere selected from each level, 
for a total of 249 terminal objectives. - ^ 4. 

* 

The development of the Spanish CPTs in Mathematics began in Fiscal 1978 
at which time the complete set of intermediate and upper level tests were 
translated and /or developed* However, major revisions were made in the 
Mathematics CPTs in English causing a complete revision of the Mathematics 
CPTs in Spanish'. A small *pilot of the topic 'Operations with Whole Numbers' 
Spanish edition had also revealed that format reauired too much 
reading apd would have to be changed in order tobetter measure the objective 
and the mathematics progress of the student. 

During fiscal 1979 tests were written ^id/or translated for the primary^ 
cycle (levels A through ,H). In the process of writing these tests, the 
writers took *^£re to a&^ure that the English and Spanish items remained 
parallel, while f ilso checking for possible cultural or linguistic bias in the 
items * f The. tests were reviewed by a panel of bilingual and mathematics 
educators and after some revisions the tests were approved* In fiscal 1979 
the intermediate and upper cycle tests (levels J through V) were revised and > 
mdny new items wers generated* It is expected that the entire Mathematics 
CmuWh Spanish will be available for extensive field testing in Fiscal 1981* 
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Placement Procedures and Longitudinal Data Base 

" " «* - - - 

The bilingual data files w^ere developed so that a student is added A^o the 
file when he or she enters the Chicago school system* The student is 
classified as to the type of instructional program that would be most 

^appropriate to meet his or her educational needs us£ng the entrance criteria* 
A profile of the educational data ^ printed for each student along with 

-iriFtructional recommendations. The file is updated monthly and students who 
transfer from one school to another are identified along with students who 
leave the system. The information on each student from a non-English 
background is updated frpm the various educational and program participation 
files which include the student Masted File, the Standardised Achievement 
record file, the Title I Achievement file, the Title I Participant file, the 
Bilingual Achievement files, the Attitude Survey files, the Special Education 
file, the Minimum Proficiency file, the Bilingual Census file, and the Access 
to Excellence file. Data from each of these files are useoMy^update the 
Bilingual data file. At: the end of each year the data available for the 
student are combined to form a final record for the student* This file is 
retained as an archive for that year. The archive file is then used to 
#t - evaluate a studerit's educational progress and Ms/her educational needs for 

fr the next year using the exit criteria*. 



^ Following the reevaluation of students a new record is created with the 

original instructional needs category, the instructional needs category from 
the previous year and \ he new instructional needs" category* The most recent 
achievement data are al-eo retained and additional space is allocated for ' 
recording of new data from the files listed above* The new record becomes the 
archive record at the end of the next year* ' 

Following the completion of the academic year a new profile is created 
for each student* TKis is sint to the school for use in development of the 
. student's educational program, A summary of the student* s instructional needs 
is used to assist in the staffing anS organization of the schc/ols. The 
4 archive tapes of each year can be combined using the bilingual merge program 

to create a longitudinal file with up to 15 years of archive /files * Selected 
f - archive years can be combined to form files of interest* The current archive 

data file is being revised to collect and maintain additional data requested 
> by the Illinois State Board of Education. Previous archive files and the 

associated programs will be converted in FY81 to reflect the additional data 
requested by the state* 

^ * The Shcprt Tests of Linguistic Skills {STLS} were developed to determine 

the language proficiency of bilingual students* Tests have been developed in 
English and 11 languages including: Arabic, Assyrian, Chinese, Greek, 
Italian^ Japanese , Korean, Pilipino, Polish, Spanish, and Vietnamese. Spanish 
and Korean versions were field tested during Fiscal 1977 and 1978, an Assyrian 

% version was completed the following year. 

During 1979-the STLS results of a sample of 100O students fluent in 
English and 500 students fluent in Spanish were analysed using the Hasch 
model, a latent trait model designed to single out items which do, not fit the 
construct of fluency in English or in Spanish. After removing the defective 
items the English and Spanish subtests were calibrated. {See Appendix F) 



5G 



V 



S 



APPENDIX 



50 



ERIC, 
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-THIS FORKJTJST BE FILLED JUT FOR: 



| (1) ALL STUDENTS WHO WERE CLASSIFIED INTO 7hE BII INGpAL PROGRAM (PROFILE CATEGORY 

\ A t B 0R C FOR 'ELEMENTARY STRUTS *A.'.^ "T"i P^RAM:' FOR MI'.H SCHOOL STUDENTS) 

*< ^ WHETHE R OR NOT TH KY ARE C lFREgT!Y P* r ' IVt SILTSC* 1 *; ?ci SERVICES 



(2) /ANy OTHER STUDENTS »*HO P?£ SC'J :\ . # -TLI*iCL 'A s - FSL INSTRUCTION OR 1ITLE VII 

RVICES, REGARDLESS OF THEIR- BIM'.UVAL ** <CFILF CftT-.GOMrS 



"7 



For students in a bilingual prograr, fill out sections *A through N, ? through U t 
and appropriate sections on ,tne reverse side. For students receiving ESL only, fill In 
sections A through N, S, and U, appro- riate sections on the reverse side, 

For students not in\ bi 1 ingual cr ESL program, fill In sections A througfTcuT, I , 
\ J,U t KK, ang appropriate sections on the reverse side. 



\ IF YOU ARE USING A PREPRINTED FORM, MAKE il) 

1 ARE CORRECT. IF THEY ARE NOT CO&RECT, DESTKOfF I 



SURE I3*3^4iE J;NlT NUKBER AND AGE CYCLE 
THE/TORM A.ND FILlTmrf^A^I^NK FORM FOR 
THE STUDENT. IF A STUDENT IS NO LONGER r'.ROljLED $i YOUR SCHOOL, YOU NEED H^F ILL 
OUT A FORM FOR THAT STUDENT. 




' ■ k ' Student Identification Number, If not preprinted, enter students eight digit number, 

B. Oolt Number. ~ If preprinted, chtt*^ accuracy . 'Fill out ney.fbrm if Incorrect. 

C - jSpop-Dlylslon Number. Fif>^^the/ student f s J digit room number. If the room number 
contains a letter, replace the letter with the number n 9\" 

h 

D* Age-Cycle.^ If preprinted, check accuracy. If incorrect, fill out new form. If filled ' ■ 

out in July through December, student's a?>e as of Dec. I, this year. If filled out 
in the Spring, student's age as of Dec. 1 la#c year. ' & 

B» Fill In H for male or F for female. ' 

F. Fill in place of birth for all students. 

01. If student is currently receiving bilingual or ESL ser /ices, fill in "yes" and go on to 
02. If student is not receiving these services, fill In ** no" and skip section G2, but 
complete sections K through J, U f KX, and the appropriate sections on the reverse side. 

G2. If the student is receiving bilingual or ESL services fill in the appropriate circle, 

S ' Language P roficleBcy Level. » Rate the student's current English language pfoficiency. 

Hote that the presence of an accent which dees not interfere with effective communication 
should not be considered in determining the student f s level. 

Level I. The student understands very little and prodjees only isolated words or 
phrases in English. * 

Level XI, The studeat understands and can .communicate in English, but^til great difficulty. 

Level III. The student comprehends most of what Is said to her/his and communicates fairly 
vail although h^r/hls fluency is not comparable to that of Level IV students. 

Level IV, The student comprehends ajr.d communicatee adequately, but her/his fluency Is 
not comparable to that of English speaking peers. 

Level V. The student's English proficiency i^ equivalent to that of native English * 
•peaking peers, 

I. Instructional Heeds Category, Assess the student's current Instructional needs. 

A Speaks and understands little or no En^jfch and needs all content area instruction 
f in the home language. =* 

« 

B Speaks and understands some English, but needs about half of her/his instruction in 
the hose language, 

C Speaks and understands English well enough to participate In a classroom in vhich 
English is used mo<u of the time, can receive almost all Instruction in English. - 

SF The pupil's language ability is equivalent to that of native English speaking peers, ^\ 
and she/he can perform adequately in an aIl-Fn#l^h classroom. 

Do • , 

r ' Ft EASE MAKE SURE THAT EACH STUDENT'S LD." iUtett IS CORRECTLY CODED. IF IT ISH*T, Till 

rKK ST UDENT WILL NOT BE I NCLUDED IN YOUR SCHOOL'S TA? LIES . 



r 



g — — ■ * — ' - ' - * - f»^-« i*-- Oi COCeS is in Appendix A 

Some cocsoonly u*ed codes are: * 

l^Arabic 21-cantonese 53-Xtalian ;s-Kcrean 04-Polish Ql-Spanish 

25-Assyrian 02-3reek Il-Japar.ese C^rilir iro/Tagal-i 07-3orbo- 
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Croatian 


X, 


Fill 


in tnc month the studert 




*r. any bilingual 


progrirs this year. 


L. 


Fill 


in how nany years tne st 


jder.t" ha 


s re-cn in the bili 


rgual program. 


M. 


Fill 


in all that apply. 








N , 


Fill 
than 


in the average number of 
299 minutes, fiM m 299 


'mnates 


per week of -T£SL 


instruction, if greater 


0, 


Gait 


this section. 









In what language is student receiving bilmguaj instruction? See list '.of 
codes in Appendix A, * 

* Fill in only for students in lineal program cr 2SL program. If a student 
does not receive hoxce language instruction everyday, determine how many 
periods per week is received, ard divid- th;s by 5 to obtain the average 
number of periods per day. (Englisr. instruction includes SSL instruction) 
Rote: The sum of the |e>ods per day m Engiisn-and home l**sSbge is usually 7, 

Enter the relevant amount of hone language and English used durilg instruction 
_ in each cf the four subject areas, Note that tr.e amounts are ranked in 5 
.categories from alsost all horse language to almost ail English Jlkntfuage 
instruction. • ; 

If you are filling ^he fom out in Sept. through Jan., osdt thi's section, I*f 
filling out in the Spring, fill m the number of days present and absent as 
of the end of the third sarfcirg period. 

T * ^ Lang oage Perfsrsance. Fill in only for students m the bilingual program. 
Estimate student's reading and speak ing/1 is tenir.g performance ir. hamW language. 
If you don't speak the student's home language, nave a bilingual teacher 
familiar with the student give his/her estate. If no estimate is available, 
fill in "don't know.** 

tJ. The person Vfilling out the forr: should sign his/her name and fill in the* 
^^^circle corresponding to his/her position. • 

TORH OVER FORM AND FILL IN APPROPRIATE SECTIONS 

If the student is in elementary school, fill out sections AA through CG, 

AA. Indicate student *s English contiguous progress reading level. 

B8.> Indicate student's home language continuous progress reading level. 

CC. Indicate/IHudent 1 s continuous progress math level. 

00 ■ In dl cat ey hether the student is in the Language m Transition program. 
EE* Ii*iii#»^Qtfhether the student is in any Title I Program other than Language in 
Transition. 

PF. Indicate whether the student is enrolled in any other special reading program, 

(i.e., TU-READ, IRIP, etc.) 
GG, Indicate whether the student or any one of his/her teachers is receiving * 

Title VII services, ^iil m all that apply. m 

HK. Fill in for all hign school students. Indicate the student's year m school, 

his/her grade point average, aVd whetner he/she has been enrolled in a readina 

lab at any time during th*s school year. . 

11,23. Fill in these section? only if *-he student has been assigned a special 
education classification wr.ether*or not they are receiving bilingual 
services. Determine trie student's code from his/her status card or 
a from Appendix B. 

EX* Fill out only for students n^t receiving bilingual or ESL services, Indicate 
the reason student is not receiving either service and fill m all, that apply. 
Also Indicate the d£te the studen t left the program. ' 
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HAKE SURE THAT TIE STUSUTT'S LUIT NUMBER AND AGL T/C LE ARJb. CORRECTLY CO^rD, 
PLEASE DO HOT ATTACH PAPER CLI*-. ^ , 3 . CR RLm BANDS TO TllT rl^; 
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fi School m^g 



Fill out sections A through J *rvd U for eH ctud&its 
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STUDENT ID NO 



UNIT NO 



Rfa/DIV 
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Language 
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Month 
started m 
program 
this year 



0 Sep 
G Oct 
O Nov 
O Dee 
Q Jan 
O F* 
O Mar 

O A P f ' 
O J "« 
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Time in 
Bilingual 
program' 



TgE I SEX J 



BIRTH PLACE 
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Male 
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c 



O 
O 
O 



lb! yr 
2 id yr 
3ra vr 

4-h yr 

5th 7r 
or mo 



ore 



Language of 
instruction, * 

Almost Almost 
alt m/ 7 home all 
Home lang " * Engl Eng! 



C 



o 



o 

Language Art% 

o Oil 

Math 

O O O 
Social Studies 

COO 

Science _ . 

o 60 
FRir 



O 

O 

c 
o 



c 

o 

r 



Who provides 
the student's 

ESI 
instruction? 



(3 Re?jj tescner 

O Endorsed Biii 
Teacher 

0 ESc »_3chc 
O Nor- :* aOCrfe 



Ou S A 
O AFRICA 
O ASIA 
O CUBA 
OEUROPiF " 

<0MExfccft" 

O ^tO-EAST- 
O PACIFIC ISLES 
O PUERTO RICO 
O OTHER LATI*S 'AMERICA 
O OTHER 



Is the student currently 
| receiving Bilingual Ser* 
%ces? 

Yes^jS> to|G2| 
No O TwM In A-J. U 



and proper 
grids on back}^ 



Service received 
(fill intone} 

f^) BBInotfal a-u 
CT'eSloriTy A*0 
If neither, A-J. U & KK 



Average no of 
minutes'Yveek 
of TESL 
instruction 
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Days Present Days Absent 
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language of 
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Home 
Language 
4 Performance 

Speaking ' 
Reading Listening 

P* Below /-s 
age *eve* 

D Af O 

age levei 

^ aqe i^vet 
0 Don i knowQ^ 



T Rater's 
Evaluation 

of Student's 
Language 
Proficiency 



Levf Q i 
Levf X$ I! 
LevS 0 |j{ 
Level O IV 
Level Q V 



Average no of 
penods day of 
instruction in 



English 



Home 
language 

9 © * 

1-19 O 

2 29 O 

O 4-4* O 

O ■ 5-5 9 O 

6-6 9 O ' 

7 or © 
more 



c 
o 

c 



o 
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Instructional 
Needs 
Category 

Oa 

Cm 

' dc 
o&p 



o 
CD 

- -*% 
C 



3 

c 

o 



<0 



9 

Cn 
CD 



O 



O 
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liVrPGRTANTl 
Please complete a!! appropriate grids 
on the other side: 

* AA-GG for ail elementary students 

* HH for all high school students 

* II and JJ for a!! students with special education codes 

* KK for all students not currently receiving 

bilingual services 

Signature of 
person com* 

plating form — 



Q Bii Endorsed tocher 

O £ SL teacher 

0 Omer tiassmo*n i^ac^e* 



Fill in only one 

0 Adjustf*-* 1 **" t»jac»««» 
0 Biiingyai coordinator 
0 Other 
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H 

O 

■o 

> 
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English 



READING 

Home 
Unguage 



© 
© 

© 



Fill -***t lot -i'i 
HiG.1 

school 
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Is the student enrolled 
in the L.IT. plPgram? 

No O % 
is the student enrolled 
m any other Title I program? 
Yes O No O 
Is the student enrolled in any 
other specs! jefiding program? 

Ves C ' No O 
Title VII services (including staff 
development^ are being received by: 
(Fill m alt that apply) 
Student Teacher Neither 

O 0.0 



I il l 811 11111 1 i 1 1 i 8 1 1 1 i 1 I 1 1 M 1 1 » 1 I I I 1 M i M I 1 I 1 i 1 i i 1 M I 
I 
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FILL OUT FOR ALL ELEMENTARY STUDENTS ONLY 

Continuous Progress Levels 

MATH 



SPECIAL EDUCATION 
Fill out ONLY if the student has been 
assigned a Special Education classification 



Year 



Jrade - 
Point 
Average 



Special Ed 
Code 
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rolled in « 
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Yes <o 
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Is the student currently receiving 
Special Education services? 
V«s /") Nr. O 
Is the Special Education teacher 
endorsed m the pupil s home 
language" 

V -S Qj*Q O 

is a teacher aide -available 
who can converse in the 
pupil s home language? 

* 

v-s O No O 



GENERAL INSTRUCTIONS 

Use ONLY a soft (No. 2 or softer) black lead pencil 
Fill in the desired circle completely and darkly 
Erase any answer you want to change cleanly arid completely 



BAD MARKS 

00<3? OgfO ©OO 



GOOD MARKS 

oo# o#o too 
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OTHER CODES 
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Fill out ONLY for Students who are not receiving btlinguaL or ESL services 
{Fill in all that apply) 



O Student is no longer enrolled at this school 

O PBterits refused consent 

O Profile indicatep* services are no Id 

O Local staff feel services are no longer needed 

O Student could use services, but staff is pot available 

O Other 



DATE LEFT F 
Month 


'ROGRAM 
Year 
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, APPENDIX B 




This form is u fill id - it* <<; ill -scents r :a , ar .-. ~yw t. t.%e Chicago 
Public schools am are f-or -: ^,ne wnere language otl.** than sriyl:s'i'js 
normally spo>ea* 



! - * * ~~ — — ^ , 

I These sections of the MQF are to be filled out 1 t 

I FOR EVERY STUDENT? A, B, C, E, J, R, S,' T, U, /or Z, BB | 

I Fill out section P only for students currently enrolled m <? bi".incu*l i 
I program* 



Fill out a blank form for vre student, completing sections C, ~ . \. and x. 

A. Language Proficiency Level;, Note that the presence of an accent */ri~ K 
does not interfere with effective '-cmmunxcation should n^t *>e qons.der^- ; 
determining the student's level, j 

Level Is The student understands very little and proiuees " «• nly isolates 
words or phrases in English. 

Level II: The student understands and can communicate m English, but 
with great difficulty* 4 . - *, V 

Leved III: Th* student comprehends most of what is said to him/her and 
communicates fairly well although his/her fluency 'is not 
comparable to that of Level IV- students. 

Level • TVi The student conprehends and cccununicates adequately, but his/ 
h£r fluency is not comparable to' that of native English- 
'speakdng peers. 

Level i V; The' student's English proficiency is equivalent to that of 
native English-speaking peers* ' 

B. Proficiency Category ( Instructional Needs) 

hi Speaks and understands little or no/ English and needs all content area 
instruction in hon» language. 

B: Speaks and understands some , English but needs some instruction in home 
language. , 

C: Speaks and understands English well enough to participate m a class- 
room in which only English is isetf. / 

Note that these do not rarrepond to the Board's bilmguaj. -prof i les-dassifi- 
facations. 



C. Studtent's birthdate* - „ . 

D6F. Omit these sections. 

E* Fill in place of birth for all students. 

XX, G, *H, & I. Omit these sect ions .V" w . * 

J* Language spoken at home. A complete list of codes is xn the Appendix A of 
the manual. Some commonly used codes are: 

10 - Arabic 21 -'Cantonese 03 - Italian 08 - Korean . 04 - Polish 1 
01 - Spanish 25 - Assyrian 02 - Greek 11 - Japanese^ 
** 09 - Pxlipino/Tagalog 07 - Serbo-Croatian 34 - Vietnamese 

K, L, M, N, 0, Q. Omit these sections. 

P« Fill this out £>nly for students in a bilingual program. Estimate, if 
possible, student' s J performance in home language* 

R. Complete this.* section last. Instructions are on 'pages. 14-27 of thi,s booklet, 
page, " 

S# Student I.D. number CHECK ACCURACY of eight-digit I.D. number* 

T* Special education code* Omit this section. . 

* * s 



U. Unit number* Fill in for all students. 

V, W & X. Omit these sections* « P 

Y. Indicate continuous progress reading and math levels for elementary 
.school students* M 



(2. Fill out yeeir in school for high school students. "Evaluation" is grade^ 
point average; + is B or better, - is C and - is D or lower. 

AA. C*nit this section* - - ^ 

BB. Indicate whether the person who administered section E can speak the 
student's home home language. 



| MAKE SURE THAT THE STUDENT'S ID NUMBER AND BIRTHDAY ARE CORRECTLY 
I CODED. PLEASE DO NOT ATTACH PAPER CLIPS, STAPLES OR RUBBER BANDS 
I TO THE FORMS 




1 11 11 1 1 mn 1 1 

CHICAGO ONLY - *LL OTHERS OVER 
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Ctl I I hi COD All CT1 iriCUTC Spy M Pfl I 



J*- 



CHICAGO ONLY - ALL OTHERS OVER 
STUOEHT NAME 

y 



STUDENT 10 NO 
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QAN RATER CONVERSE 
IN STUDENT S NON 
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VES C NO O 
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FILL IN FOR ALL STUDENTS 



RATER'S 
EVALUATION OF 

STUDENT S 
v LANGUAGE 
PROFICIENCY 

O 

Om 

O LEVEL ill 

O level iv 

Q LEVEL V 



OFICIEN 



LANGUAGE 
PR<MC1HNCY 
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APPENDIX C 

OHSLKVUliT 



School 



Unit [ Teacher 

9 /O // /2* - 



Room , Ago Cycle , T6tol time of classroom visit: 

1 *• Class size — 25*2£> 



-J- j .;. / 

DAT* J 

(mo ) ») (< 

3 - i u -i 



13 /V /3 



2 - a - Number of adulr.s giving 

, instruction or supervision 2/7 
1 2 3 4+ 

b - Identify; (give number) 
Teacher 2S 

Teacher aide ^ 

^Student teacher 30 

t Parent $ l 

Other & 



1 minutes 

22 25 Z¥ 

7 - Instructional Content: (crock all 
that apply} 



r 



^Arithmetic 5*6 
^Language Arts /English 5*7 
^Language Arts/Native 5? 
^Science 5^ 

J&ocial Studies/Skills to 

_Art, Music, Drama (el 

^Physical Activity, Free Play ±1 



3 - 



A - 



Program Jlc^el: (check all that apply) 

f ^> elf Contained i3 

fJT eam (reaching W 
_JPuil Out 3b 

Depar tne ntai i zed 3k 

Other£? 

Facilities: (check all that apply) 

Regular fclassrcomS? 

Mobile classreora 31 

^Conferen'ee or small room 4° 

Other, non-instructional area fl 

(hallway, cdat room, lunchrocm}^ 



8 - Role of Teacher (check .all that 
apply) 

Q uestioning , Discussing £3 

Answering , Assisting i'/ 
* Shov and . Tell, Demonstrating 5 

P raising ' ^ 
__pis cip 1 i ni ng 
Supervising, Directing &? 

Other b ^ 



JXother, L i«deauate 2-inadeauate 

5- Role of Teacher Aidi: (check all that apply) 

;No aide present #1 

- Reinforcing instruction with a group 4% 
Tutoring -5 
Supervising rffr 
Clerical ^? 

Resource -fi 

Other H 



9 - Observer's rating of tL-ne used 
by teacher in English and 
native language : 



English _% 7o- 7t 

NativB j% 72-75 



/ 6 - Instructional Grouping: (check all that ' 

apply) 

fthole class receiving instruction f£ 

;Part of cl.i. r. roccivi.ui i./.Lruci ion SI 

Whole clas^j ;.-*?,:ir.q i.vkv . rd :nUv 12- 

L «;.all urouii u.'»kina vn * h i '--ucn^r 

Srull arc::-* srrj -./iih t'. nchcr aid- £7 

Oth^r 3 ^ 
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12 - KiLTiber of ffctf5ing groups 



*3 Er.qlish 



0 
0 



12 3 
12 3 



4 E-i 
4 5+ 



13 - Type of Approac/i t jod in Teaching 
English lanqjLiac / rtc ; (cheek all 
tivit apply} 

TTSL 

^Kccdir*q Merits 



14 - Don, cLos have c* LZI? scrvico 
available? * ■ 



1-Ycs 



2-No 



15 - teacher keeping track of CP/KL? 

l-Yes 2-No 

16 - Teacher u?c-n CP c<«rd-? J; 

l-Yes 2-Ho 

17 - Teacher u ... b native CP/?\L? i< - 

1-Yes 2-No 

/ 18 -Poacher u^eo Individualized 
- rH^earning PI or,? <2-l 



1? 



,.f y. 



2 f J 





. ?. i 






3 - 


2 year 




3 - 


4 y. 




5 - 


e ; ye,-. 


4. 


7 ■ 


C. yt^., , A 


5, 


9 - 


i C yi k .j ' 


0. 


11 ~ 


12 


7. 


13 - 


) 4 yr ars 


B. 


15+ 




- Teaching 


Co^ta f } ~at: 4 : (C 


£13 


tliC*. 




3 1 * FTR 




35 






36 Pill 




37 


Oth? 


r 


- Level (c) 


cert i f icu* 



33 1 1 <- j .ritary 

3f I -t- r. »^d< at o 

fu _ Scc:cnc:.ry 

22 - RaLir.g of Teacher's Lam < 

V* EngL's!. 1 2 3 4 5 
Native 1 2 3 4 5 



3-Yc 



2-Ko 



APPENDIX D 



Bilingual Education Program s 1978-70 
^ — 

Teacher Questionnai re 
Dear Teacher , 



School Unit 



The data obtained from this survey will bo Dart -f * , , 

you. 7 Principal or bi^ngual coordinator* Thank 



Department of Research and Evaluation 
Bilingual Unit, Room 215 I 
2021 North Burling - Mail ftun #2 2 



Please fill in or circle the appropriate 

I* In which bilingual program model 
do you teach? 

' "1. Self-contained 
2. Team Teaching 
3* Integrated full day 

4. Departmentalized 

5. Pull out 

6. Other {specify) 



2. Approximately what percentage of 
pupils who are now in your class 
began in your class in September 
of 1978? 



responses 
4 



How many years have you been 
teaching in bilingual programs? 

123456783 10+ ' 

For what leVel(s) arc you certified? 

1- Prir iry 
2*, Intf mediate 
3. Secc .lary 



/U 



/7 
it 
i 7 



6, Do you have a bilingual endorsement? 
¥es m No x Q 



1. 80% to 100% 

2. 60% to 79% 

3. 40% to 59% 

4. 20% to 39% 

5. 0% to 19% 



7. 



3. What is the average age cycle of 
your pupils? 



1* 

2. 
3. 
4. 
5, 
6, 
7. 
8. 
9. 



f 

J 



5-6 yrs 

7 yrs 

8 yrs 

9 yrs 

10 yrs 

11 yrs 

12 yrs 

13 yrs 

14 yrs, 



Please list the languages ycu uce 
in the classroom and give your level 
of proficiency in each one. 





Language 


Proficiency 










, Fair Good 


Excellent 


A* 


English 


1 2 


3 


& 






1 2 


3 


8. 


In 


the - 


^ssroom, apprcxii 


-.ately what 




percent 


* time per Week ( 


io vr-i use 




English 






& 


1. 


80^* 


-o 100% 






2. 


GO* 


-0 79% 






3. 


40 = 


59%' 






4. 


20* 


o 39% 






5. 


19' 


or less 
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9* In your experience this past year, 
^>w much of a problem h?vf> you 
had with the following? 



Problem 
Minor Major 



A. 


Insufficient 














supplies 


1 


2 


3 


4 


5 


b: 


Transiency of 














students 








A 




c. 


Class has a 
wide age 














range 


J. 


z. 




A 
H 


c 

D 




Class has a 














range 


1 


2 


3 


4 


5 


E. 


Class has £ 
wide English 














range 


1 


2 


3 


4 


5 


£ * 


tion a^ong 














teachers 


1 


2 


3 


4 


5 


G. 


Lack of support 


of 












adminis tra tor s 


1 


2 


•3 
-> 


*» 


r; 
.J 


H. 


-t>a w f. u>i. an uiuc 


JL 






J4 


5 


2. 


Class is too 














large 


1 


2 


3 


4 


r 


J, 


Parents* lac!: of 














Interest 


1 


2 


3 


4 


5 




Too much testing 1 


2 


3 


4 


5 




Too many que* ;tion- 












naires and f**rras 


x 


2 


3 


4 


5 


H. 


Other: 












What 


do you think could 


be 


done 


to 



make bilingual e< ucation more 
^ successful? 
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10, For each of the foljcvirj sM,<i v :onr 
pl^-cisc* indicate v/nn^h lir- >ni( ■ '-\. 
arc most likely^ to ul- v. i* . your das' 
(use thf: key below to .-..v/cr ^ur^ 
A through ii) . 



1. only native 

2. mainly nat ive 

3. bo th language s equally 

4. mainly English 

5. only English 



A. Asking pupils to line up tc 
to lunch. 

1 2 3_ 4 5 



3, Telling pupils to put their things 
away ar,d prepare fcr d^soissaj, 
1.2 3 4 5 

C. Tellir-j the class to be qu'rt, 
12 3 4 5 

4 

D. Tel liner pupils that they should 
get tr " r parerts* written 
permission to go or. a cxass '.rip. 

I i 3 4 5 

Z~ Asking the pupils to pay a l ,t€3ticr. 
to an . -.nounceinent. over th*-* PA. 

II 3 4 '5 

F* Show ir tfie c}^^ how to do a 
math i ^Llem* 



G. Teachl * Social Studies 
1'345 

H* Teach 4 * Science 

1.345 



12. What do 
imperial! 



think i 4 ho r.ir s t 
*t,l of bilingual odu^auicr 



APPENDIX E 



Criterion-Referenced Tests 



Objetivos Terminales 
Nivel A 



la- A- 3 
la-A-5 

la-A-7 

la-A-9 
la-A-10 

3-A-l 

3- A-2 

4 - A- 3 

5- A- 4 

6- A-l 



Los alumnos: 

» 

Seleccionaran el conjunto con el mayor numero de elementos, 
dado dos conjuntos, uno de los con juntos con dos o tres 
miembros, el otro de ocho a diez miembros. 

* 

Podran decir si el nuniero de objetos en un conjunto es "mis 
que, 11 "menos que, 11 "igual que," el numero de objetos en el 
otro conjunto, dado dos conjuntos, 

Seleccionar^i el numeral que nombra el numero de cada conjunto, 
1 dado un conjunto de objetos, de uno hasta cuatro. 

Asignaran el numeral "o fl al conjunto sin miembros. 

Identif icaran el primero, el segundo, y el tercero en la serie, 
dada una serie de objetosj 



Uniran los conjuntos y nombraran el nuniero de objetos en el 
conjunto nuevo, dados dos conjuntos de objetos que hacen un 
total de no mas de cuatro. 

Supr^miran un nuniero especificado de objetos dado un conjunto 
de cuatro p menos. objetos. 

Identif icaran y nombraran cada parte como un cuarto, dada una 
unidad entera qife ha sido dividida en cuatro partes eongruentes. 

Determinaran si la longitud de dos objetos es la misma o 
distinta* 

Identif icaran y nombraran cada uno, dadas varias muestras de 
circulos, triangulos, rectangulos, y cuadrados. 



7^ 



ERIC 



MAESTRO la-A-3(a) 

El Maestro dice: , Mira la hilera con la estrella. iCual de los 

conjuntos (grupos) tiene mas miembros, el con junto de 
perros o el conjunto de conejitos? Haz una "X" sobre 
el conjunto que tiene mas miembros. 

Mira la hilera con el corazon. £Cual de los conjuntos 
tiene mas miembros, el conjunto de los autos o el 
conjunto de los camiones? Haz una "X" sobre el 
conjunto ""que tiene mas miembros* 

Mira la hilera con la manzana, £Cual de los conjuntos 
tiene mas miembros, el conjunto de los arboles o el 
conjunto de las casas? Haz una t! X ,f sobre el conjunto 
que tiene mas miembros. 

Mira la hilera con la taza. £Cual de los conjuntos 
tiene mas miembros, el conjunto de libros o el conjunto 
de lapices. Haz una f! X ff sobre ei conjunto que tiene mas 
miembrosu 

Mira la hilera con la flor. iCual de los conjuntos 
tiene mas miembros, "el conjunto de los zapatos o el » 
conjunto de las gorras(cachuchas)? Haz una ff X ft 
sobre el conjunto que tiene mas miembros* 



CLAVE DE RESPUESTAS 



1} 


X sobre 


el 


conjunto de perros 


2) 


X sobre 


el 


conjunto de camiones 


3) 


X sobre 


el 


conjunto de arboles 


4) 


X sobre 


el 


conjunto de lapices 


5) 


X sobre 


el 


conjunto de gorras 



Objetivos 

Seleccionaran el conjunto con el numero mayor, dado dos conjuntos, uno de 
los conjuntos con dos o tres miembros, el otro.de ocho a diez miembros. 



■ - ' 75 

* Criterion-Referenced Tests 
Department of Research and Evaluation 
Board of Education of the City of Chicago, Chicago, Illinois 
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Sopfrlghi 1979 - Board of Bdueatlen of 
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APPENDIX F 

The "Short Tests of Linguistic Skills 11 and Their Calibration 1 

The Short Tests of • Linguistic Skills (STLS) (1976) were developed by the 
Chicago Board of Education to help the teacher determine language dominance of 
Spanish bilingual children ages 8-13. The STLS battery consists of two 
parallel tests, the English test and the Spanish test. Each test is divided 
into four subtests: listening, reading, writing and speaking, with 20 items 
in each subtest. . Some of the items were multiple choice; with the number of 
choices ranging from two to four* others are scored as right or wrong by 
the examiner. - 

One of the two goals of the tests is to determine the level of English 
proficiency of the student. If the student knows enough English we do not 
need to investigate further. 1 The other goal is to determine the level of 
Spanish proficiency which will help us determine the student's placement in a 
bilingual program, once the English test has established that need. In this 
paper it will be shown how bad ""items can be weeded out through the use of 
Kasch moder techn ique . Using the same technique of the remaining pool of 
items develop two sets of calibrations will be developed, one for the English 
tests and the other for the Spanish test. 



1. Item Calibration and the Pasch Model 

The technique for norming is based on the Hasch no del . The Fasch model is 
based on some common sense conditions: 

1* $he test is measuring performance on a single underlying trait or 
Ability. 

2. y-?r-\more able student always has a better chance of success on an 
item than does a less able student. 

Any student has a better chance of success on an easy item than 
on a difficult one. 




Fran these conditions it follows that a student's likelihood of success 
on an item lff^a consequence of the student's ability and the item*s 
difficulty. Hasch 's stochastic response model describes the probability of a 
Successful outcome of a person on an item only as a function of the student's 
ability and the item's difficulty. Item difficulties can be estimated 
independently of the student's abilities, thus making t^he concept of a norming 
sample irrelevant. The tests of item fit which are the basis for item 
selection are^sensitive to high discrimination as well as to low, and so lead 
to the selection of those items which form a consistent definition of the 
trait and to the rejection of- exceptional items. 



1 Agrawal, Khazan C. "The 'Short Tests of Linguistic Skills' and Their Cali^ 
bration." TESQL Quarterly, vol. 13, So. 2, June, 1979, pp. 185-208. 



Wright and Mead ( 1976), have developed a computer program BICAL, based on 
the Rasch model/ which produces estimates of item difficulties and ability 
scores, well as a test of fit of individual items. Items that do not fit 
well are dropped and the retraining pool is recalibrated. The process is 
repeated until one has a homogeneous set of items that represent the construct 
being measured. 



2. Sampling Considerations 

In order to minimize the proportion of students that might have guessed 
the answers, we use those students who are relatively fluent in English for 
the English test, and those primarily Spanish-speaking for the Spanish test. 
Students with teachers' ratings of 5 and 6 (on a* scale of 1 'to 6} on* English 
fluency are used in our calibration. We also limit our sample to those 
students *who scored above a certain number, another way of ensuring that 
responses are close to students 1 abilities and guessing is minimal. As 
pointed out, no separate calibration for different age groups is necessary; 
the sample we have chosen is 1 drawn across all age levels (8-13) to which the 
test is applicable. 

3. Calibrating the English Test 

We started put with a sample of 1000 students from English fluency 
categories 5 and 6, and performed Hasch analysis on the English test items 
using the BICAL program of Wright and Meade. Students with numerous missing 
scores were dropped. Analyses using different cut-off points (minimum and 
maximum acceptable scores) were attempted, to obtain optimal conditions to 
test the fit. Also separate Rasch analyses were carried out on the four 
subtests of Listening, Heading, Writing and Speaking. All the analyses were 
in general agreement as to the items that did not fit well* 

Dropping some misfitting items resulted in a battery that measured the 
construct of English Proficiency fairly well. The final battery on which our 
calibration is based draws from all four subtests. The analyses also 
suggested areas of the test and cluster of items, which were subsequently 
dropped, that did not conceptually measure the construct being measured. In 
the following pages we briefly discuss those parts of the subtests from which 
items have been dropped and the reasons why. The reader should look at the 
items in the test (Table 1) while reading this section. The explanations are 
by no means exhaustive; on the contrary, they are merely the most simple and 
obvious. Table 1 gives a brief sketch of the test along with the correct 
responses where possible for quick reference. 

4. Items Dropped from Calibration 

English Listening, Part A: Items 1, 2 and 5. 

Here the tester reads a word and the students check the word they think 
was said. These items are heavy on problematic sounds, and their mastery does 
not necessarily mean proficiency in the language or vice versa. Sofne testers 
themselves might have idiosyncrasies in pronouncing these words, making the 
students 1 - task more difficult. 
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ENGLISH LISTENING, PART C. This part is loaded w£th/ factual questions that* * 
might^have more to do with general knowledge than with* knowledge of - EnglT2h>-*-*^/ 

* * - ■ , * 

ENGLISH FEADING, PART A: ITEM 1. This question is too easy,, and discriminates " 
poorly between people with good and poor English proficiency. 

ENGLISH READING, PART C: ITEMS 13, : 14 AND 15. Questions 13-arid 15 deal with.' 
mathematical ability? fluency in English will be of very little help in solving 
the problem, e.g. , counting each person mentioned in the paragraph or * 
dalculating the number of months elapsed. In question 14, identification of 
April with Spring is a culturally bound phenomenon and might 'nt>t be, a measure 
of English proficiency. Questions 13-14 do not fit the construct. 

ENGLISH WRITING, PART A; ITEMS 1, 3 AND 5. Knowledge of difficult spelling is 
not an index of one's knowledge of English. Questions 1, 3 and 5 fall into a 
"somewhat difficult 11 category. 

ENGLISH WRITING, PART B: ITEMS 1, 2 3. These items are quite easy. It 

appears that students with lower ability are doing as well as or better than 
more advanced groups who might tend to become careless about easy items. These 
items might also be measuring some ability not confined to English proficiency. 
In any case, they do not fit well in the construct. 



5. Calibrating the Spanish Test 
i 

For the Spanish test we choose a sample of 500 from the English proficiency 
category 1, i.e., primarily Spanish-speaking students. As with the English 
sample, this sample was drawn randomly from all age groups. Rasch: analysis was 
performed using the BICAL program* Only a small number of items were found to 
be misfits in the construct of Spanish proficiency; they yexe dropped and the 
analysis was repeated unfil a good fit was obtained. 

The dropped items are discussed below, followed ^by a brief layout of the 
Spanish test in Table 2 (Pp. 198-206). 3 

The items on which the Spanish test is calibrated are in Appendix C; the 
conversion table for raw score from these items. to ability scores is in 
Appendix D. * 

• i 

o. Items Dropped from Calibration ig- J 

SPANISH LISTENING, PART As ITEMS 1, 2. Students who in general have more 
knowledge of Spanish seem to do poorly on these items? they ^o not, therefore, 
belong in the construct. 



3 For the complete test the reader is referred to the SHORT TESTS OF LINGUISTIC 
SKILLS (1976a, 1976b). 
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SPANISH LISTENING, PART C: ITEMS 12, 14. For UeS^a student/ s knowledge *of 
arithmetic is more important than his/here knowled'ge afNspanish. Item 14 has -a 
cultural bias and, therefore, does not fit in the construct of Spanish 
proficiency* 

SPANISH READING, PART D: ITEM 19. This is a bad item; there is no clear right 
answer and knowledge of Spanish will not help, 

SPANISH WRITING , PAPT A: ?B^iy%. "This is a , tricky spelling item; knowledge of 
this word does not have much to do with knowledge^ of good Spanish, J 
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Table P 
The English Test 



English Listening, Part A 

, Students darken the circle in front of the word they hear said. 



X 


i 


0>C! 


• jet 




X 




Opesi 


Obesf 


• ve>i 


ft 


3 


• bet 


V Obait 


Obat 




4 


Obus 




• buu 


V 
A 


5, 


• \iiip 







English Listening, Part B 

Students wnte the words/phrases (shown) read to them. 






6, 


Will 


© 




7 


• 

fam 


© 
© 




8. 


At *ne tahl? * 


.© 
© 


■t t 


9 


A spoonful of so gar 


© 

© 




10 


There is no such thing 


© 
© 




* 






* 

a 








*- 

f 
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• Table 2 
The Spanish Test 



Spanish Listening. Part A t Escuchando espatioi, parte A ) 

Los alumnos obscttreceran el circulo al frente de la palabra que han escuchado. 



1. 




C jauta 


Ojala 


2. 


, Oota 


#oila 


Ojova 


. 3. 


Oesta 


. Oesto 


$ fcsta 


4. 


Opera 


#pero_ 


O perro 


5, 


• pilla 


Opillo 

— - t 


' Opirta 



Spanish Listening, Part B (Escuchando espafiol. parte B) 

Los alumnos escnbiran las patabras/ f rases miostradasj que le han sidoleidas 



% indicated fhe correct response 

X indicates Kern was dropped from calibration 



6. 




Oveja . ' 


© 
© 


7. 


V 


Guitarra 

— > 


© 
© 


8. 




Traje de banc 


© 


9. 




I 

La galljna come maiz ^ 


© 


10. 




EI nifio juega en el parque 


© 

© 
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